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I. INTRODUCTION 


A. HISTORICAL BACKGROUND 

Any task requiring the accurate retention of information by any means, including 
human memory, involves some form of coding. Basically a code is a collection of 
symbols for sending messages or storing data. Codes have been used since the time of 
early man. Cave scratchings, notches on a stick, hieroglyphics, modern alphabets and 
number systems are all codes. Militarily, some applications of codes have been to send 
battle orders, report on victories or defeats, transfer needed Operating information, and 
to display the tactical situation. 

In ancient times, most engagements were on a scale which allowed a commander 
to stand atop a convenient hill and control the movement of forces simply by visually 
observing the battlefield and sending the needed orders to his field commanders. A 
classic example of this occurred in 480 BC when King Xerxes of Persia was enthroned 
feo a cliff to wateh the Greeks defeat the Persian Fleet at the Battle of Salamis. 
(Potter, 1981, pp. 2-5) As warfare progressed, both the numbers of units involved and 
the size of the battlefield grew to the point where a commander could not hope to view 
all actions from a single vantage point. This lead to the use of maps and charts to 
display the tactical battle area and the use of various locally developed symbols to 
represent the units involved. At first runners where used to carry information to the 
commander’s location for inclusion in the tactical display. As technology improved, so 
did the means of getting information to the commander, and likewise the amount of 
information also increased. 

Today, the amount of information available to a commander 1s phenomenal. It 
1s transmitted electronically to his flagship or command post and 1s continually 
updated, often in near real time. This requires a maximum amount of system 
integration and coordination to insure the data is both available and put to the 
optimum use. The current situation in the surface navy is aptly described by Friedman 
Miso, p. $2): 


In the past, integration was manual; different radars, for example, fed into a 
single vertical summary plot in the combat information, center (CIC), and a ship 
was fought on the basis of that integrated plot. The information was transmitted 
manually, . . . —In a confused” and rapidly changing situation, manual 
contributions can become inaccurate and the plot can be saturated. NTDS was 


invented in the 1950s. to solve this problem; radar operators individually enter 
their contacts electronically, so there 1s no intervening plotter or talker. 


The US Navy has adopted a specific set of symbols to represent tactical 
information, it 1s commonly referred to as the standard Navy Tactical Data System 
(NTDS) Symbology and is shown in Appendix A. Of primary importance are the 
locations of all contacts, their classification (friendly, neutral,or hostile), type (air, 
surface, or subsurface), and their movements. Currently, the NTDS displays are 
monochrome phosphor green displays of the appropriate contact symbols on a polar 
projection. When using NTDS, as with using any code, the challenge is to be able to 
retrieve the needed data from the visual display quickly and accurately. This requires 
the optimization of coding, taking into account the way people view the displays 
(physiology) the way they interpret what they see (psychology), and the limitations of 


the equipment involved (technology). 


B. CODING 

“A code is generally typified by a set of stimuli or symbols that represent in some 
specified manner events in the external world.” (Jones, 1962, p. 355) 

A great deal of work has been done in trying to determine what tvpe of coding or 
combination of coding schemes will allow a human operator to perform a given task 
with the greatest speed and accuracy. The most prevalent coding schemes involve 
alphanumeric, symbolic, acoustic, color, or any combination thereof. When code 
schemes are combined, for example: color coded symbols, redundancy can occur. 
When the two coding patterns provide the same information and can be utilized 
independantly of each other, this is total redundancy. In the case where one coding 
pattern supplies only part of the information and acts to help reduce uncertainity, 
while the other supplies all of the needed information, the code is then referred to as 
partially redundant. (Teichner, 1977) 

Experiments suggest that the use of combination codes (redundant or partially 
redundant) can increase the amount of information transferred either by increasing the 
alternatives or improved discrimination between the existing alternatives presented. 
(Jones, 1962, p. 357) Redundancy coding also tends to improve the reliability of the 
information extracted and lowers the time needed to respond to the information when 
presented. (Burdick, 1965, p. 4) When utilizing redundant coding techniques it is 
critical to avoid overcoding, this tends to require the user to spend more time reviewing 


the code than in using the information it presents. (Oda, 1977, p. 81) 
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A well thought out and properly implemented code can increase the effectiveness 
of a Commander’s decision making process. However, there are occasions when there 


can be too much coding: 


... any coding operation that is intended to enhance the discriminability of 
targets may also enhance any distracting effects due to nontargets... , the greater 
the number of nontargets, the greater would be the otential inhibition -.. A 
search code must_be lu ged on its ability to Sau e targets from nontargets 
under various levels of display density. (Jones, 1962, p. 360) 


Research has suggested that there are three key parameters that exist in 
determining the value of a coding scheme. These are the exposure time of the 
individual to the display, the density (number of informational data points) present, 
and the specific response demanded of the operator. (Jones, 1962, p. 359) 

The visual display is utilized as a tactical decision aid for such ‘response required’ 
tasks as search, identification, localization, counting, and verification. (Kantowitz, 
1983; Luder, 1984). A search task can be defined as one in which the operator knows 
the categories in advance and his or her task is to locate them correctly on the display. 
Identification requires identifying targets as to type (air, surface, subsurface) and threat 
(friendly, hostile, neutral). Localization tasks involve determining a given targets 
bearing and range in relation to own ship, or a preselected grid reference, which ts 
known as the Data Link Reference Point (DLRP). Counting is simply determining 
how many targets are present. Verification requires a means of positively identifying 
targets, as by IFF (Identification, Friend or Foe) or backing up data obtained from 
another sensor, for example, radar locating a target on a Electronic Warfare signal 


intercept bearing. 


C. VISUAL DISPLAYS AND COLOR CODING 


Visual search displays present complex coding problems the resolutions of which 
scem to depend on the. particular attention getting quaiitics of a_ code 
continuum... This may explain the. ellective use of color_as a.means of reducing 
display clutter when used as a partially redundant code. Even in search situations 
without redundant coding, color facilitates target location. (Jones, 1962, p. 362) 


An examination of the literature by Oda (1977, pp. 195-197) determined 12 


specific selection criteria that apply to coding as related to tactical displays: 


1] 


1. Displays are easier to interpret if qualitative codes (ones color) present 
qualitative information. (tvpe, condition) and Cea codes (size, numbers) 
present quantitative information (course, speed). 

2. Priority in. code choice should be based on the number of information steps 
encoded. For example: using three color steps to represent hostile, friendly, and 
neutral contacts. 

Past proven codes in similar tasks should be used whenever possible. 

4. Priority should be given to standardized codes and group HO ie to 
cue recall. Exaniple: red for hostile contacts and the standardized NTDS 
symbols. 


5. Use nonredundant coding whenever possible. Use partial redundant coding to 
separate signals from noise in highly cluttered displays. 


6. Use dissimilar codes on,the same display to avoid confusion. Do not encode 
several kinds of information with the same code. 


7. The code should be compatible with the environment it 1s to be used in. For 
example: using an audible alarm in,a high noise environment is inappropriate. A 
flashing red strobe in the same environment would be appropriate. 

8. Codes should be compatible with the capabilities of the operator. In a tactical 
environment, the avoidance of comphcated codes that require a great deal of 
concentration to understand should be avoided. 

Chosen codes should conserve display space. 


10. A code’s attention getting capacity should be proportional to the importance of 
the coded information. 


11. Codes which allow for ordering of importance should be given precedence over 
those that do not. 


12: eles should be able to be implemented easily with the available hardware and 
software. 


Color coding involves the use of various colors to define the elements of 
information being presented. A typical human operator, with average color perception 
can distinguish approximately 150 separate shades of color across the visible spectrum 
from the reds to the violets. (Krebs, 1978). Computer color chips can produce a 
virtually unlimited range of color shadings by varying saturation levels on a typical 
average of 16 separate colors. When using color as an enhancement, it 1s 
recommended that not more than four colors be used at any given time. (Oda, 1977, p. 
172) To limit the possibility of mistaken interpretation by an operator, the colors used 
should be separated in the visual spectrum enough to avo having to distinguish 
between shadings of a single color. Red, white, yellow, blue, and green on a dark 
background are the most commonly utilized colors codes. (Oda, 1977) An additional 
factor to consider, is relating choice of colcr to traditionally accepted meanings 
associated with that color, for example: red tends to be representative of danger or 


threat. 
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Research has shown that color coding is useful in situations where the display 1s 
unformatted, symbol] density 1s high. and legibility may be degraded (Krebs, 1978, p. 
44). Studies have also indicated that color coding is most applicable to two types of 
tasks, namely search and identification (Luder, 1984, p. 19). These are precisely the 
tasks performed when using a tactical display system. 

A color code used in conjunction with a shape code could enhance the ability of 
the operator to search out and identify specific classes of targets (friendly, neutral, or 
hostile). An additional benefit may accrue from the man-machine interface involving 
the operators eye and the display. On the standard NTDS display screen, average 
symbol size 1s .125 inches. The eye 1s capable of distinguishing shapes down to a size 
of .15 inches (Oda, 1977, p. 173). It is understandable that errors in distinguishing 
shape would be highly likely in a high density, stressful environment such as a tactical 
engagement. The addition of a partially redundant color code could backup the 
current shape code, identifying a targets classification. The shape would still be needed 
to determine the specific type of target involved. 

Color is not presently employed on any NIDS display screens used by the Battle 
Group Commander. Current microcomputer installations aboard ship are beginning to 
use color displays to enhance data recovery and provide some esthetic enhancement to 
these displays. 

The inherent complexity of a tactical display system suggests the utilization of 
the most efficient coding system possible. The limited categories (neutral, friendly, or 
hostile) and possibilities for target classification (surface, subsurface or air) lend 
themselves ideally to a partially redundant coding scheme. The visual graphic format 1s 
ideally suited to the use of color as one of the key elements. A potential method of 
achieving the required level of efficiency involves using the current NITDS symbology 
combined with a color code. 

In an attempt to improve the current NTDS display by addition of color, the 
following situation is possible. The primary application of color could be to distinguish 
between friendly, neutral and hostile target sub groups. Tlius would require only three 
colors. The choice of colors should follow traditionally established color schemes in 
the attempt to enhance search times and the ability to recall target locations by the 
operators. This traditionally accepted system is RED for HOSTILE contacts, GREEN 
ieee OlRAL contacts, and BLUE for FRIENDLY contacts. Current CRT 
technology permits the use of these three colors with adequate saturation to permit 


distinguishing between them under the present lighting conditions in fleet C1C’s. 
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In the preceding pages, background material has dealt with the mechanics of 
coding, both in general and specifically dealing with the Navy’s system of NTDS. In 
order to fully evaluate the effectiveness of an additional partial redundancy (color), it is 
necessary to understand the human mechanisms involved in code processing. As well as 


the method used by individuals to organize the available data. 


D. CODE PROCESSING 

Every glance at a newspaper, a television, or a CIC tactical display results in 
information being processed by the brain. However, every piece of information is not 
handled with the same priority or at the same speed. 

Experimental research (Teichner, 1977, pp. 12-13) has shown that certain codes 
have a higher processing priority than other codes. For example, an alphabet (shape 
code) has a higher priority than color dots (color code). This result can be attributed in 
part to the user’s familiarity with a given code. The alphabet has been part of an 
individual’s environment since early childhood, while a colored dot code would have 
had much less exposure time. This priority of processing seems to operate on this 
familiarity. The more familiar a code, the higher the priority. Even if the code is not 
part of the daily environment, shape codes seem to have higher priorities than other 
codes, such as color. The importance of these priorities comes into play when the code 
has multiple parts (1.e., shape and color). Different priorities can exist which may 
cause part of the code to be overlooked or processed at a later time. If this code uses 
its separate parts to transmit different information then problems could result: such as 
the loss of information or incomplete information which can cause delays in the 
decision making process. On the other hand, if the code is partially redundant then 
multiple paths can exist for the information to be processed by the user. 

Codes (or parts of a code) can be processed at different speeds. The speed 
difference is assumed to be caused by the processing method used by the brain. When 
the brain processes information one step at a time, the method 1s called serial 
processing. If the brain can process the information over several steps simultaneously, 
the method is called parallel processing (Norman, 1969, p. 8). Several experiments 
(Luder, 1984, pp. 21,31; Saraga, 1973, p. 265) have indicated that color undergoes 
parallel processing and shapes undergo serial processing. 

This dual processing mechanism can lead to interference between codes. A color 


which is an irrelevant factor will be processed faster than a relevant shape factor, even 
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if the user has a different processing priority. The interference could degrade the 
information flow. On the positive side, use of color as a revelant factor could increase 
the information flow rate. If the color was partially redundant, then the information 


flow rate could increase, though it wouid be incomplete. 


E. CHUNKING 

When presented with a visual display, the user can be more efficient when he 
organizes the information into discrete groupings called chunks. This chunking 
Strategy occurs regardless of the type of code used in the underlying physical 
mechanism that transfers the information to the brain. 

The strategy for developing these chunks can be based on numerous 
relationships. Some of the more common ones are (Badre, 1982, p. 497): 

A) Classification relationship: such as grouping together all the circles in a display. 


B) Spatial/Geometrical eee Os such as grouping by quadrants, or by 
locations relative to each symbol. 


C) Tactical relationships: each piece of data has a meaning and can be associated 
with other pieces of data through that meaning. 


One measure of effectiveness (MOE) of a code is in its information transfer 
ability; or in other words, how easily can the user group the code into information that 
can be used to make decisions. The type of MOE 1s directly related to the effectiveness 
of the chunking strategy being used by the individual (Kanarick, 1971, p. 188). The 
more effective the chunking, the better the individual will perform. 

Research has shown the one of the primary factors influencing the effectiveness 
of a code 1s the experience of the user. An individual who understands and has worked 
with a system (1.e., the real world that the code represents, as well as the code itself) 
can develop more relationships between pieces of data (Badre, 1982; Frey, 1976, p. 
542). The more relationships that can be formed, the larger the chunk which can be 
processed. In addition, the experienced user can see relationships between chunks 
which makes using the information easier. Chunking can cause greater efficiency, as the 
more experienced user can gather more information in shorter periods of time. It 1s 
believed that by using well defined chunks, the user either entirely bypasses the Short 
Term Memory (STM), or quickly goes through STM (Frey, 1976, pp. 545-546) to Long 
Term Memory (LTM). STM is the working memory of the brain, having a very 


limited capacity for data. LTM is the final storage place for all information processed 
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by the brain. (Kantowitz, 1983, pp. 174-175). If all the information needed to make a 
decision is in a well defined chunk, the process of retrieval from LTM is simplified, and 
the decision making process time decreased. 

In summary, different types of codes, or code combinations, have an effect on the 
ultimate purpose of a code: information transfer. With the increasing complexity of 
information available to a tactical decision maker, as well as the multiple tasking 
stresses, a military code must take advantage of all aspects of the processing and 
chunking mechanisms. The question of this thesis 1s whether multicolor partial 
redundancy will aid in the efficiency of the NTDS code. 

Color could conceivably aid in information transfer in two ways. First, by 
speeding up the processing time of the code. A decision maker will look at a display, 
then look away to perform some other task. To ensure maximum efficiency, the time 
required for the user to find the symbols of interest after this break (1.e. search time) 
should be a nunimum. Color has been shown to decrease search time (Burdick, 1965, p. 
27). Second, color could improve chunking techniques by providing additional strategy 
paths. These paths could result in larger chunks, decreasing the time required to 


organize the chunks, and better/more relationships between distinct chunks. 
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Il. EXPERIMENT DESIGN 


A. OVERVIEW 

As discussed at the end of Chapter I, the primary objective of this thesis was to 
determine the effect of partially redundant color coding on a search and identification 
task. To achieve this objective, several key variables were identified that affect 
performance in a search and identification task. If the partially redundant color code 
has an effect (positive or negative) in this type of task, then it should show up in an 


analysis of these key variables. The key variables were: 


I. display density (number of targets present) 
Pe viewing time 


3. chunking methodology 


Development of the experiment led to several hypotheses concerning the 
principal variable of partially redundant color coding, as well as concerning the key 
variables. Basically, the null hypothesis was that partially redundant color coding 
would have no effect on the subject’s ability to perform the assigned task. The 
alternate hypothesis was that partially redundant color coding would have an effect, 
either positive or negative. This effect would be reflected by an increase or decrease in 
the number of correct responses relative to a control group. These null and alternative 
hypotheses were applied as the key variables were changed. In other words, partially 
redundant color coding would have no effect as display density varied, view times 
changed or on chunking techniques. 

In addition, several underlying hypotheses were tested, with respect to the key 
variables. For display density, the null hypothesis was that the number of targets 
present on a given display would not effect the performance of the subjects. The 
alternate hypothesis was that a change in display density would effect performance. 
The null hypothesis for viewing times was that varying viewing time would have no 
effect on performance. The alternate hypothesis stated that viewing times would effect 
performance. Any change in performance would be determined from the number of 


correct responses--which will be defined shortly. 
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Finally, it was assumed that some form of chunking would be employed by the 
subjects. Three specific types of chunking were looked for: classification, geometric 
and tactical. Chunking by classification was assumed to be very likely, the subjects 
were able to chunk by threat type (i.e. submarines, or aircraft etc). This technique 
could result in some type of hicrarchy of responses, which could be analyzed for 
tactical relevance. The second possibility was chunking by geometric location. This 
would be indicated by more correct responses in a specific region of the display than in 
other regions. Third, chunking could occur based solely on tactical significance. In this 
case, correct responses would relate to various types of contacts and their relationships 
with each other. . 

As mentioned, this experiment has several arcas of cross analysis. To clarify the 


setup, Table | shows all tests and interrelationships. 


B. GENERAL DESCRIPTION OF EXPERIMENT 

Duc to the time demands on the available subject population, the experiment was 
designed to allow maximum data collection, in the shortest amount of run time. The 
experiment consisted of the subjects reading a short descriptive scenario concerning 
their duties, followed by the subjects viewing several tactical displays. Immediately after 
viewing each display, the subjects were asked to reconstruct it on blank plots. Upon 
completion of this reconstruction phase, the subjects were asked to copy a display. The 
final phase involved filling out a short questionnaire. Examples of the material 
provided to the subjects is shown in Appendix A. Each run involved 2 to 3 subjects 


and lasted approximately 20 minutes. 


C. DETAILED DESCRIPTION OF THE EXPERIMENT 
1. Scenario 
The scenario was written to establish the “duties” of the subjects when 
viewing the projections. The primary intent was to establish a tactical situation 
(antisubmarine warfare related) which would allow the subjects to tactically chunk if 
they wanted to. 
2. Displays 
The displays consisted of polar plots with NITDS symbols at various contact 
locations. The plots were centered at an arbitrary point with four concentric range 
rings. North-south and east-west lines established four quadrants. The displays were 
created using a Commodore 64 personal computer and a graphics software package. 


Each display was generated on a 320 by 200 pixel high resolution color monitor. 
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Two basic displays were shown. The, first display was an 18 target 
(unsaturated) plot; the second was a 36 target (saturated) plot. The number of targets 
used for each display was based on similar experiments by Badre (Badre, 1982). In 
addition, each display was duplicated in monochrome (green on black background) and 
in color (red, green, and blue symbols, white plot on black background). These displays 
are shown in Appendix A. 

To allow some flexibility in conducting each run, the displays were 
photographed on 35mm color slide film. The camera was set up approximately two feet 
in front of the screen using a 50mm lens at F1I-8. The film was at ASA 400, with an 
average exposure time of 4 seconds. This exposure time allowed the individual pixels 
to record on the film. The problem with this exposure time was that the film’s color 
balance tended to change: the colors faded. To correct for this problem, mle shdessyere 
touched up with transparency markers. In the monochrome case, the entire slide was 
tinted green. 

Each surface symbol on the display occupied a 7X7 pixel image area, the air 
and submarine contacts occupied a 7X4 pixel area. Appendix A, Figure A.2, maps 
each symbol by pixels utilized. Each symbol was used the same amount of time 2 of 
each symbol in the unsaturated display, 4 of each symbol in the saturated display. This 
would allow for comparisons between specific threat types as Well as threat categories. 

3. Environment 

Each run was conducted in a classroom setting. Due to high utilzation of 
classrooms, the exact location varied from run to run. In every case, the room was 
darkened to allow viewing of the displays by test subjects. The projector was set up at 
eye level to allow a flat, distortion free display. Each run display averaged three feet 
across the polar plot. 

4. Reconstruction Phase 

To allow for accurate comparisons between monochrome and color display 
effects, each run consisted of only one mode, (only color displays or only monochrome 
displays). Thus the subjects were either part of the control group or the prime variable 
group. 

Within each run, viewing time and saturation levels were varied. Subjects 
were first shown the unsaturated display for 10 seconds, then were asked to reconstruct 
it. This same procedure was followed for saturated, 10 seconds. No time limit was 


placed on the reconstruction. 
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Since the displays were not to be varied between exposure times (contact 
location remained the same) an attempt was made to distract the subjects and prevent 
recall between the two phases of the run. This distraction consisted of a series of 
questions, and then the viewing of several naval slides. By disrupting the flow of the 
experiment, it was hoped that the subject’s STM lost the data from the first phase. 

The second series showed each slide for 60 seconds, followed by a 
reconstruction. In an attempt to avoid prejudicing the subjects towards or against the 
color code, the subjects were provided with color pens (red,green and blue) for use 
during the reconstruction. No instructions were provided on the use of those items. 

5. Copying Phase 

In order to establish a baseline for determining the type of chunking being 
used, the subjects were required to copy the saturated plot while being observed by the 
experimenters. The purpose of this task was to observe how often the subjects referred 
to the display for information and to see the method they used to copy the display. 

To record the times, a program was written for a Radio Shack M-100 
computer to allow single keystroke entries. These entries would record each subjects 
identity and the time of each look. While one experimenter was performing this task, 
the second experimenter noted the pattern and number of targets recorded with each 
look. Due to this procedure, each run was limited to 2 or 3 subjects. 

6. Questionnaire Phase 

The final phase of the experiment run required each subject to fill out a 
questionnaire. This questionnaire tried to determine each subject’s subjective analvsis 
of the chunking method used, the effect of time, the effect of saturation and the effect 


@iecolor. 


21 


II. DATA ANALYSIS 


A. POST EXPERIMENTAL DATA GRGANIZATION DESCRIPTION 

The experiment was conducted utilizing subjects available at the Naval 
Postgraduate School in Monterey, California. Twenty Junior Naval Officers 
participated in the experiment. The subjects represent a random sampling of the 
tvpical personnel who would be called upon to employ tactical plots similar to those 
utilized in the experiment. The sample population profile included Lieutenants and 
Lieutenant Commanders from all major warfare areas (surface ship, submarine, naval 
aviation, and ashore technical staffs) and with varying degrees of familiarity with 
NTDS symbology (ranging from none to a great deal). A detailed profile of the twenty 
subjects is included in Appendix A (Table 25). 

The twenty subjects were divided evenly between the two primary test cells. As 
has been previously indicated, the experunent had to be conducted in small groups to 
facilitate proper and essential data recording by the experimenters. To limit the effects 
of nuisance variables, such as-environmental differences (lighting, noise levels, etc.), the 
experiments were conducted in similar classrooms, with similar ambient noise levels. 
The various subject groups were all given identical initial indoctrination briefs at the 
beginning of each experimental run. The only indoctrinational differences occured 
between the two primary cells (color and monochrome). In the color case the subjects 
were told that colors would be used, and which colors went with which threat symbol 
type; 1e. Friendlics were Blue, Hlostiles were Red, and Neutrals were Green. The 
control group was informed all symbols would appear in a monochromatic shade of 
green. Additionally, to avoid prejudicing the subjects as to the relative imiportance of 
color in their decision processes and reconstruction efforts, the cclor group was 
supplied with red, green and blue pens while the control group was supplied with just 
green pens. In both test cells, the order of presentation of the displays was identical 
and as follows: 

i. 10 Second Unsaturated Display 
2. 10 Second Saturated Display 
60 Second Unsaturated Display 
60 Second Saturated Display 
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Saturated Display Reconstruction 
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The subjects were given an opportunity to ask questions at the beginning of the 
test run to clarify what was expected of them. Questions concernin g the use of colors, 
methods to be employed, or what grading criteria were being employed were not 
answered. All subjects had thesame basic information concerning the experiment and 
its purpose priorto their being tested. 

Upon completion of each test run, the individual subjects turned in 5 plotting 
sheets, corresponding to the 5 items in the order of presentation a personal data 
summary, and the questionnaire described in Chapter II. At the end of the experiment, 
there were 80 plotting sheets to be graded for correctness of responses and 10 plotting 
sheets and questionnaires be analyzed in determining chunking methods. 

In grading the plotting sheets, a response was considered ‘correct’ if it was the 
correct symbol and in the correct location on the polar plot. The plotting sheets were 
graded by just one individual to reduce any biasing errors in determining what 


constituted a ‘correct’ response. Upon completion of grading the resulting data wa 
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Figure 3.1 Analysis Units. 


organized into manageable analysis units according to Figure 3.1. 
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Figure 3.2 details the Specific Areas of Comparison utilized in the Data Analysis. 
Where appropriate, the actual cell comparisons are noted within the figure. In the case 
of chunking, methods of analysis are described elsewhere in the text. 

The BATCH consisted of the total number of correctly located symbols, 
We earcless Of type Or group, on each plot, for ALL TEST SUBJECTS. 

The SUBBATCHES were created by subdividing the batch by the total number 
of correctly located symbols for those subjects FAMILIAR with NTDS (SubBatch 1), 
and those NON-FAMILIAR with NTDS (SubBatch 2). 

The PRIMARY CELLS divided the data between those completed with 
MONOCHROME (cell 1) or MULTICOLOR (cell 2) Symbology. 

new SECONDARY CELLS further subdivided the data by density into 
SATURATED or UNSATURATED cells; and by time into 10 second and 60 second 
cells. 

The GROUPS and ELEMENTS were the finest subdivisions utilized in the 
analysis. The following list details these. In cach case, the Element represents the 


number of correctly plotted responses 1s the indicated category. 
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It is easy to see from the above that considerable data was accumulated in the 
course of the expermment. Several elements in the Quadrant/Circle area had no 
symbols within them and were eliminated, this results in batches and sub-batches 
containing 37 elements for saturated secondary cells and 33 elements for the 


unsaturated secondary cells. 


B. STATISTICAL ANALYSIS DESCRIPTION 
Statistical Analysis was performed utilizing the Naval Postgraduate School 
Mainframe IBM 370/3033 Computer with an installed statistical programming package 
known as MINITAB. MINITAB was created in 1972 by the Pennsylvania State 
University for use by students tn statistical analysis courses. It has since been 
expanded to allow use by anyone required to organize and analyze a large amounts of 
data. (Rvan, [972, p. i) MINITAB was utlized to perform four basic analytical 
functions: 
1) Plotting of raw data 
2) Calculation of percentages 
3) Conducting a Two Sample T-Test 
4) Conducting a One Way Analysis of Variance 
The raw data was plotted merely to determine if any obvious trends were present 
and as a guideline towards further evaluation, the percentages were calculated for 
similar reasons (Example plots are in Appendix B). From these two initial evaluations, 
It was determined that the Two Sample T-Test and a One Way Analysis of Variance 


(AOV) would be the primary tools in analysis of the experiment. 
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1. T-Test Analysis Technique 
The first major analysis was performed utilizing a TWO SAMPLE T-TEST. 
This test 1s designed to compare two independant samples using a Students T-Test 


and a 95% Confidence interval. The following equations are the basis of the T-Test: 
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This test 1s used to determine whether or not two samples have the same 
mean. The test prints out the means, standard deviations, standard error of the means, 
Meee tevaluc and a p value. 1hé p value is compared to a given alpha (in this cuse 
05) based on the desired confidence Icvel, 1f ‘p’ is less than alpha then the null 
hypothesis (equal means) is rejected. (Ryan, 1985, pp. 184-187) After the iniual series 
of runs, it was discovered that the T-Test results corresponded exactly with the 
Analysis of Variance Results. From that point on, only the variance test was uulized. 

2. Analysis of Variance Technique 

The remaining analysis was done utilizing the One Way Analysis of Variance 
(AOV or ANOVA) feature of MINITAB. The null hypothesis for all comparisons was 
that there would be no change due the addition of color, any variation in target 
density, or in changing the time of exposure to cach tactical display. In other words, 


all samples would have the same means if the null hypothesis were to hold true. 


Ilo = M = M 


color monochrome 


OT 


Ho = M = M 
10 seconds 60 seconds 


Or 


Ho = M = M 


saturated unsaturated 


To test these hypotheses with AOV, the following conditions had to hold true: 
1) the sample had to be random 
2) the population must have a normal! distribution 
3) the samples must have the same variance 
Of these things, the most important requirement is that of randomness. 

MINITAB output for AOV comes in two parts. The first part consists of 
tabulated data concerning the two populations under comparison, the second part 
describes the two sample populations (i.e., means, standard deviations, 95% 
Confidence Level (CL), and size). AOV calculates the sum of the squares,mean 
squares, degrees of freedom, and the F-Ratio. Of these, the degrees of freedom (DOF) 
and the F-Ratio are used to determine if the null hypotheses are true. The F-Ratio’s 
and DOF’s are used, together with the CL (.05 in this case); to enter the Statist s 
F-Distribution Table found in the CRC Standard Mathematical Tables (Beyer, 1984, p. 
549). If the F-ratio calculated in MINITAB was greater than the tabulated value for 
the given DOF and CL, then the null hypothesis in question was rejected. (Appendix 
B has examples of AOV results for the Chunking Analysis). 

The remainder of this chapter discusses the actual analysis of the data. The 
following sections concern time change analysis, density change analysis, color analysis, 
and chunking analysis. Each analytical section covers each Batch/Sub-Batch as a 
separate area. At the end of each area is a set of stand-alone conclusions concerning 
that area. (Appendix C consists of tables which show all the intercellular analysis 
results). 

Chapter IV will discuss the possible causes and ramifications of the 
conclusions and trends noted in this chapter. Additionally, a final set of conclusions 


either supporting or not supporting the hypothesis of Chapter IT will be given. 


28 


3. Definition of Terms 
- To aid in understanding the following analyses, the following terms should be 


understood: 


BASIC FACTOR - The variable that is being changed in that particular analysis. 
iMiererare three BASIC PACTORS: 
1) Time 
2) Density 
6) Color 


BASIC RELATIONSHIP- The relationship between the number of correct responses 


and the basic factor. 


EXTENDED FACTOR- The effect of color on a change in one of the remaining two 


factors (time or density). 


EXTENDED RELATIONSEIIP- The relationship between the number of correct 


responses and the extended factor. 


SIGNIFICANT DIFFERENCE- Any difference which meets the AOV criteria 


established previously in this chapter. 


C. TIME ANALYSIS 

The basic time analysis null hypothesis was that changing the exposure time 
(time allowed for the subject to study the display) would have no effect on the subjects 
responses. In the extended null hypothesis time of exposure would not be effected by 


the addition of color to the displays. 


i 
xt € m 
c= color 
m= monochrome 


X= time factor 


An analysis of variance test was run on all elements in the primary cells based 
on the secondary cells concerning time. The intracellular comparisons were: 
monochrome 10 second versus monochrome 60 second, and color 10 second versus 
color 60 second. The intercellular comparisons were; color 10 second versus 
monochrome 60 second and monochrome 10 second versus color 60 second. The 
density secondary cells were held constant throughout this set of comparisons. The 
intercellular results were quahtatively compared to the intracellular results. If a 
difference was found in both sets for comparative element samples, then that difference 
was assumed to be due to the basic factor (time). If the difference was not duplicated 
in the intracellular comparisons, then the difference was assumed to be due to the 
extended factor (presence or absence of color coding). A summary of the significant 
ANOVA results are shown in Tables 2 - 9. An overall summary of the percentages, 
showing the significant effect of time and those possibly associated with color are 
found in Table 10. 


1. Batch 
a. Unsaturated Displays 
(1) Intracell Comparisons. 

The monochrome test cell did not support the basic hypothesis. The 
results showed a 33% increase in correct results as the exposure time was increased 
from 10 seconds to 60 seconds. The color cell also failed to support the basic 
hypothesis. The color results indicated a 79% increase in correct results as the 
exposure time increased. 

(2) Intercell Comparisons. 

(1) Monochrome 60 Second vs Color 10 Second. When significant 
differences occured, the monochrome elements demonstrated 52% better results than 
the color elements. Only 6 of these elemental comparisons could be explained by the 
time differences. 33% of the differences could have been duc to a lack of color coding 
in the display. This does not support the extended hypothesis and seems to indicate 
that a monochrome display may have a positive effect on subject performance. » 

(2) Monochrome 10 Second vs Color 60 Second. When a significant 
difference was noted, the color elements consistently showed improvement, in this case 
55% over monochrome. All but 2 of these differences could be explained by the time 


factor. The addition of color seemed to improve performance by 6%. 
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TABLE 2 


EXTREMES OF SIGNIFICANT A: 
lEMveexINA Yolo: INI RACEDIULAL 


10 Second Unsaturated versus 60 Second Unsaturated 
MONOCHROME 


Batch 
F-Ratio = 4.41 
Upper Value 


SOURCE JOR 
FACTOR i 
ERROR 18 
TORAL 19 
Lower Value 


SOURCE D 
FACTOR 

ERROR a 
TOTAL i 


iy 
0 ies 16): 
0 


subBatch 1 
F-Ratio = 5.99 
Only Value 
Ruse 


ERROR 
TOTAL 


M E 
40.50 12.46 
S025 


SIO 


SubBatch 2 
F-Ratio = 4.96 
Upper Value 


SOURCE BES 
Pec LOR it O62 
ERROR ‘ 


al 
TOTAL il 
Lower Value 


SOURCE BAS S) 

PACIOR 1 5.000 6. 43 
ERROR © . 467 
GOmAG ave. 
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TABLE 3 


EXTREMES OF SIGNIFICANT ANOVA Seale 
TIME ANALYSIS: INTRACELLULAR II 


10 Second Saturated versus 60 Second Saturated 
MONOCHROME 


Bacen 
F-Ratio = 4.41 
Upper Value 


SOURCE D 
FACTOR 


MS EF 
OASIS as 19.79 
ey ll 
Lower Value 
SOURCE D 
FACTOR 
ERROR AL 
TOTAL aL 
SubBatch 1 
FeRatio = 5.99 
Only Value 
SOURCE D 


F S ish 
uf cee 10. 64 
ERROR S 2 


bo 
M~JOY) 
NOAaYN 
On] 


SubBatch 2 
F-eRatio = 4.96 
Upper Value 
SOURCE DE 
FACTOR iL 
ERROR Eo 
TOTAL il 
Lower Value 
SOURCE DF 
FACTOR iL 
ERROR @) 
EORAL alt 


E 
102 0¢ 
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TABLE 4 


MES OF SIGNIFICANT ANOVA RESULTS 
IME ANALYSIS: INTRACELLULAR III 


iO, pecons Unsaturated versus 60 Second Unsaturated 


Batch 
FeRatio = 4.41 
Upper Value 


SOURCE DF 
FACTOR il 
ERROR 18 
TOTAL 19 
Lower Value 


SOURCE D 
Pee LOR 

ERROR 1 
TOTAL 1 


MS B) 
mrs or AS) 


Suobatch 1 
FeRatio = 5.99 
Upper Value 


SOURCE DF 
FACTOR al 
ERROR 6 
TOTAL 7 
Lower Value 
SOURCE DF S 
FACTOR af ieee 2S 
ERROR 6 Oz 50 O. 
AMG BRA IL, fi, leo his 
SubBatch 2 
F-Ratio = 4.96 
Upper Value 
SOURCE DF 
FACTOR Ali 2 
ERROR a8, 
TOTAL ial 
Lower Value 


SOURCE D 


M F 
84. 50 67.260 
iz 


MS F 
24.083 Soe2e 
S F 
So C00 ee des 

5 SIS 
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Ties 


EXTREMES OF SIGNIFICANT ANOVA RESUUTS 
TIME ANALYSIS: INT RACE REE ATS 


10 Second Saturated VS 60 Second Saturated, COLOR 
Baten 
F-Ratio = 4. 41 
Upper Value 


SOURCE DF 
FACTOR il 
ERROR 18 
TO LRAI 19 
Lower Value 


SOURCE IDNs 
FACTOR 1 
ERROR 18 
LOLTAL TS 


Subbateh sl 
Boat dOnt. 
Upper Value 


SOURCE BA 
FACTOR 1 
ERROR 6 
TOL 7 


Lower Value 


SOURCE PE 
FACTOR 1 
ERROR 6 
LOTAL i 


MS EF 
Zea OO ZV cas 
Os533 


SsUubBaten Z 
F-Ratio = 4.96 
Upper Value 
SOURCE D 


Lower Value 

SOURCE DF 
FACTOR al 
ERROR LO 
TODA seal 


34 


Pei tes OF o1 Gus lis 
UVP AN Ae StS: 


Monochrome 10 versus Color 60 
Batch unsaturated 


F-Ratio value = 4.41 
Upper Value 


SOURCE DFE iz 
Beato Ee 


Lower Value 
SOURCE D 


SubBatch 1 unsaturated 


Feratio value =5.99 
Upper Value 


SOURCE Duet 
FACTOR il 
ERROR 6 
TOTAL 7 


Lower Value 


SOURCE DE 

PAG TOR 1 : d 
ERROR 6 Vig O18) 0. 
TOTAL 7 4.00 


F 
2 ek 


SubBatch 2 unsaturated 


F-ratio value =4. 96 
Upper Value 


SOURCE Ba Ie 
PAGIOR 1 1 S) 30. 41 
ERROR | 2 


ak 
Om AL, all 
Lower Value 
SOURCE DF 
FACTOR 1 


ERROR ab 
AMONG a IG 1 
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TABLE 7 
EST HOT AANA REE” 
Monochrome 10 versus Color 60 
Batch saturated 
F-Ratio value = 4.41 
Upper Value 
Ruse 


ERROR i) 
fOTaE ii 


Lower Value 


SOURCE D 
PACroR 

ERROR il 
LO il 


MS E 
540. 80 29 aoe 


SubBatch 1 saturated 
F-ratio value =5.99 
Upper Value 


SOURCE De 
PAC LOR 1 
kK RROR 6 
TOTAL i 


Lower Value 


SOURCE DE 
plein Ole ue 
BRROR 6 
TOTAL i 


SubBatch 2 saturated 
Feratio value =4. 96 
Upper Value 


SOURCE DE 
PAGCOR al 
ERROR © 
TOTAL che 


Lower Value 


SOURCE By 
FACTOR fl 
BRROR 10 
ARON Wey L, eal 


TABLE 8 
ERE VES OF SIGNIFICANT ANOVA RESULTS 
tiie ANAL YSIso UN PERCELLUOLAR. III 
Monochrome 60 versus Color 10: 
Batch unsaturated 
FeRatio value = 4.41 
Upper Value 


SOURCE DF Ss MS F 
FACTOR il HOR 25 LOZ 25.47 
ERROR 1s W/E 40) 3.98 
TOTAL 19 i {GARE S)'S, 
Lower Value 
SOURCE IDs SS MS E 
FACTOR al 8.45 8.45 4,46 
ERROR 18 62 Le 1.89 
mOanA Ta 19 42.55 

SubBatch 1 unsaturated 
Feratio value =5.99 
Upper Value 
SOURCE Dir Ss MS EF 
FACTOR iL 18.00 IS 1Ol0 2 GL IONS, 
ERROR 6 4.00 O67 
TOTAL i 22.08 
Lower Value 
SOURCE DF Ss MS 
FACTOR a ey 1S ora gles: S239 
ERROR 6 Stes 0.96 
TOTAL 7 1k, Sk 

SubBatch 2 unsaturated 
Feratio value =4.96 
Upper Value 
SOURCE DF SS MS EF 
FACTOR BE OZ =O O27 =O 8.18 
ERROR Age) 124.80 2 0 
TOTAL ih al 2260800 
Lower Value 
SOURCE DF SS MS F 
FACTOR al Zee PAGS 8.00 
ERROR 10 ZO, o7 ZO | 
JMOMBAIE Wal 48.00 
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TABLE 9 


MES OF eae A NOW AGES Wiis 
IME ANALYSIS: LS PERCE RBI. 


Monochrome 60 versus Color 10 
Batch saturated 


F-Ratio value = 4.41 
Upper Value 


SOURCE Bile 
Pe ie ix a 
ERROR Ke 
TOTAL 12 


Lower Value 


SOURCE 
FACTOR 
ERROR 
TOTAL 


In 
Tee 


he W 
WOH] 


SubBatch 1 saturated 


Feratio value =5.99 
Upper Value 


SOURCE DF ish 
PECUCk 1 8.00 24. O€ 
ERROR 6 , 3S 

TOTAL ah 


Lower Value 


SubBatch 2 saturated 


Fe-ratio value =4. 96 
Upper Value 


SOURCE DF 
PACZOR 1 
ERROR 1O 
LOTAL cr 


Lower Value 
SOURCE D 


MS iF 
TO Zane 8.26 


E 
3 S, 0 
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TABLE 10 
SUMMARY OF TIME ANALYSIS IMPROVEMENTS 


Batem SubBaten, | SUbBatecha 
Intracell 
Unsaturated 
M60 vs M1O Joe 618 6.0 
CoQenrs GA.0 T2. 0 302 0 ZO 
Saturated 
M60 vs M1O 46.0 8.0 ee © 
C60 vs M10 49.0 Lo” © ZZ. 0 
Intercell 
Unsaturated 
M60 vs ClO S30 L220 ALS, 
C60 vs M1O 6.0 ike. 16 6.0 
Saturated 
MGO vs C10 8.0 8.0 S20 
C60 vs M1O 24.0 30.0 3020 


Ab PERCENTAGES INDICATE IMPROVEMENT AT 60 SECONDS. 


Percentage calculations: total number of differences 


ECOGal weomparilsons 


Ge Fors 
60 seconds 


monochrome c 
10 seconds 60 


[H 
O 
fi tl 


39 


b. Saturated Displays 
(1) Intracell Comparisons. 

The monochrome cell did not support the basic null hypothesis. The 
results indicated a 46% improvement with increased exposure time. The color cell also 
failed to support the null hypothesis. These results showed a 49% improvement with 
increased exposure time. 

(2) Intercell Comparisons. 

(1) Monochrome 60 Seconds vs Color 10 Seconds. As in the 
unsaturated case, the monochrome elements showed an improvement over the color 
elements (38%). All but three of these results could be explained by increased 
exposure times for the basic factor. The lack of color seems to have had a positive 
effect in the remaining three cases (8%). 

(2) Monochrome 10 Seconds vs Color 60 Seconds. Again, the color 
elements showed an improvement over the monochrome elements, this time in 70% of 
the sample cases. All but 9 clements could be explained by the increased exposure 
time. In this case, it appears that the addition of color had a positive effect on 
performance in 24% of the cases. 

2. SubBatch 1 
a. Unsaturated 
(1) Intracell Comparison. 

The monochrome cell showed only a 3% improvement with time, this 
tends to support the basic hypothesis. The color cell showed a 30% improvement with 
time, this leads to a rejection of the basic hypothesis. 

(2) Intercell Comparison. 

(1) Monochrome 60 Seconds vs Color 10 Seconds. The monochrome 
elements showed a 15% improvement over the same elements in the color cell. Only 
one element was attributable to the increase in the time factor. The lack of color 
seemed to have a positive effect in 12% of the test cases. 

(2) Monochrome 10 Second vs Color 60 Seconds. The color elements 
showed a 33% improvement over the monochrome clements. Of these differences, 
45% could be attributed to the increase in the basic factor. The addition of color 


seemed to have a positive effect on performance in 18% of the sample cases. 
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b. Saturated Displays 
(1) Intracell Comparisons. 

The monochrome cell showed an 8% improvement with increased time. 

The color cell showed a 19% improvement with time. 
(2) Intercell Comparisons. 

(1) Monochrome 60 Seconds vs Color 10 Seconds. The monochrome 
elements showed an 8% improvement over the color elements. None of the differences 
were attributable to the basic factor. The lack of color seems to have been beneficial 
in 8% of the test cases. 

(2) Monochrome 10 Seconds vs.Color 60 Seconds. The color clements 
Showed a 43% improvement over the monochrome elements. Only 32% of the noted 
differences could be explained by the time factor. The addition of color seems to have 
had a positive effecting 30% of the cases. 

ey subbateh 2 
a. Unsaturated Displays 
(1) Jntracell Comparison. 

The monochrome cell showed a 6% improvement with time. The color 

cell showed a 27% improvement with time. 
(2) Intercell Comparison. 

(1) Monochrome 60 Seconds vs Color 10 Seconds. The monochrome 
elements showed a 18% improvement over the same elements in the color cell. Only 1 
element was attributable to the increase in the time factor. The lack of color seemed to 
have been beneficial in 15% of the cases. 

(2) Monochrome 10 Seconds vs Color 60 Seconds. The color elements 
showed a 21% improvement over the monochrome elements. Of these differences, all 
but 2 were caused by the increase in the basic factor. The addition of color scemed to 
have a positive effect on performance in 6% of the sample cases. 

b. Saturated Displays 
(1) Intracell Comparison. 

The monochrome cell showed an 11% improvement with increased 

time. The color cell showed a 22% improvement with time. 
(2) Intercell Comparison. 
(1) Monochrome 60 Seconds vs Color 10 Seconds. The monochrome 


elements showed a 5% improvement over the color elements. None of the differences 


4} 


were attributable to the basic factor. The lack of color seems to have been beneficial 
mn all the test cases. 

(2) Monochrome 10 Seconds vs Color 60 Seconds. The color elements 
showed a 46% 1tmprovement over the monochrome elements. Only 34% of the noted 
differences could be explained by the time factor. The addition of color seems to have 
had a positive effect on 30% of the cases. 

4. Initial Conclusions Concerning Exposure Time 
1) The basic null hypothesis seems to be invalid in all but 1 case; in SubBatch 
1 the unsaturated monochrome display results indicated only a 3% improvement. 
2) The extended time hypothesis also seems to be invalid. 
a) For the UNSATURATED cases, the monochrome display effected the 
over all results more significantly than in the color displays (33% vs 6%). SubBatch 2 
demonstrated this trend to a lesser degree (15% vs 6%). In Sub Batch 1, those familiar 
with NTDS, the opposite trend was indicated, that is color had more effect than 
monochrome in 18% of the cases versus 12%. 
b) When the displays were SATURATED the color coding affected all the 
results to a greater degree than monochrome feature did, regardless of exposure time. 
3) There was little evidence that the addition of color aided one SubBatch 
more than it did the other. Research results by other cxperimenters indicated that 
color would help those unfamiliar with the symbology more than it would help those 


familiar with the system. (Teichner, 1977, p. 17) 


D. DENSITY ANALYSIS 

The basic null hypothesis was that the number of correct responses would not be 
effected by the number of symbols in the display. The extended null hypothesis 
concerning density was that color coding would have no effect on these results. 

To determine the vahdity of this hypothesis, a total of 8 AOV tests were donc , 4 
for each time. One run compared within the monochrome cell, another within the color 
cell, and the final two between cells. As with the time analysis, the same tests were 
repeated for the batch and the two subbatches. The specific tests were sect up as 


follows: 


1) Monochrome Unsaturated vs Monochrome Saturated 
2) Color Unsaturated vs Color Saturated 
3) Monochrome Unsaturated vs Color Saturated 


4) Color Unsaturated vs Monochrome Saturated 
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The AOV tests compared the first 20 elements of each cell, this covers the first 
four groups, type, group, type & group, and quadrant. A summary of significant 
ANOVA results are in Tables 11 - 18. A summary of the percentages is idole: 

1. Batch 

a. 10 Seconds 
(1) Intracell Comparisons. 

At least 90% of all the elements supported the null hypothesis (95% in 
the monochrome case). When any significant differences were noted, the saturated 
displays always had the higher percentages of correct responses. 

(2) Intercell Comparisons. 

(1) Monochrome Unsaturated vs Color Saturated. No differences were 
noted, the extended hypothesis scems to be valid. 

(2) Monochrome Saturated vs Color Unsaturated. 3 differences were 
noted, only one of which was explainable by reference to intracell results. In the 
remaining cases, the monochrome displays had ‘better’ results. The specific elements 
were Surface Type and Quadrant 2 responses. 

b. 60 Seconds 
(1) Intracell Comparisons. 

So omoumtic colopeciements and 70% of ‘the monochrome ones 
supported the null hypothesis. In both cases, the total number of correct responses 
was significantly better for the saturated displays. This tends to support the alternate 
hypothesis that the means between the two population samples were not equal, and 
specifically, that relatively ‘better’ responses occur with the saturated displays. 

(2) Intercell Comparisons. 

(1) Monochreme Unsaturated vs Color Saturated. Only | difference 
was found and it could be explained by the basic relationship. 

(2) Monochrome Saturated vs Color Unsaturated. 9 differences were 
found, with all but 3 being attributable to the basic relationship. For the remaining 3, 
the friendly contacts, hostile surface, and quadrant | elements were significantly ‘better’ 


in the saturated color displays. 
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10 Second Saturated vs 10 Second Unsaturated 
MONOCHROME 


BATCH 
F-Ratio = 4.41 
Only Value 
ouce 


ERROR a 
TOTAL 1 


WN 
ONO 
WOUTLBM 
MOY 
i 
No 


SUubBatenw! 
F-Ratio = 5.99 
Upper Value 


SOURCE DE 
PAC LOK 1 
KRROR 6 
TOGA ara 


Lower Value 


SOURCE DE 
PACLOR il 
ERROR 6 
TOTAL aa 


OO0ON 
OO0ON 
ree) 
Os 

O 


CO~J 1-4 

SIUIN WM 

MOUINM 
Oo? 
Wr 


Supbaccnsz 
F-Ratio = 4.96 
Upper Value 


SOURCE De 
FACTOR al 
i 


Od 


ERROR ul 
TOTAL al 


Lower Value 
SOURCE D 


H NOD 
WOO 
HWOM 
SIQNWN 


Ore 
h~] 
NUTS 
OoN 


oe @ 
hovind 
MOUNN 
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VAI 12 


60 Second Saturated vs 60 Second Unsaturated 
MONOCHROME 


Batch 
F-Ratio = 4.41 
Upper Value 


SOURCE DFE SS MS EF 
FACTOR al 18705 hee S i726 
ERROR 18 18.50 iO 3 
TOTAL 19 66.55 
Lower Value 
SOURCE DE SS MS 
FACTOR ili 762.00 162606 6.69 
ERROR 18 204. 50 11.40 
TOTAL 19 230250 

SubBacch 1 
F-Ratio = 5.99 
Upper Value 
SOURCE DFE SS MS EF 
FACTOR al lie Mee! 12250 Pa O16) 
ERROR 6 6) 010! , 50 
TOTAL al al PS.50 
Lower Value 
SOURCE DF SS S EF 
FACTOR i Vad. APA V2 Ae WALA a: 
ERROR 6 Loe 5 Zan? 
TOTAL el SiacG7 

Slibpeasem. 2 


NO SIGNIFICANT DIFFERENCES NOTED 


45 


TABLE 13 


: wMES OF SIGNIFICANT ARG ieee 
DENSITY ANALYSIS# INVRACGE RD Gir sin 


10 Second Saturated versus 10 Second Unsaturated 
MONOCHROME 


Batch 
NO SIGNIFICANT DIFFERENCES NOTED 


SubBatch 1 
Feratio value = 5.99 
Only Value 
SOURCE DF SS MS EF 
FACTOR 1 Zola Zale 18376 
ERROR 6 6.475 lel? 
TOTAL a ZLGH 

SubBaten. 2 
Feratio value = 4.96 
Only Value 
SOURCE DE SS MS EF 
FACTOR il 14.08 14.08 7.48 
ERROR ae Hs) SiS 7) 1. 88 
TPOqeAL de 32392 
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TABLE 14 


S 
DENSITY ANALYSIS: s: ATRACEL 


60 Second Saturated versus 60 Second Unsaturated 
COLOR 


Baten 


Feratio value = 4. 41 
Upper Value 


SOURCE Die: SS MS 
FACTOR 1 6.05 6.05 6.44 
ERROR 18 eye Si8, 0.939 
TOTAL 19 22895 
Lower Value 
SOURCE DF SS MS EF 
FACTOR al 242720 24. 20 34.57 
ERROR 18 TZ Ono 
TOTAL 19 36. 80 

SubBatch 1 
Feratio value = 5.99 
Upper Value 
SOURCE DF SS MS EF 
FACTOR i 8.00 8.00 LS al 
ERROR 6 S50 0.58 
TOTAL Heal flea ®) 
Lower Value 
SOURCE DFE SS MS F 
FACTOR 1 ety elles open WA 7.74 
ERROR 6 4.750 One? oz 
TOTAL a: LO7S 7S 

SubBatch 2 
Feratio value = 4.96 
Upper Value 
SOURCE DF SS MS EF 
FACTOR 1 T6.3s3 Tees 5 24.50 
ERROR EO 6.667 OF 667 
TOTAL 13k Zo, 000 
Lower Value 
SOURCE DF SS MS EF 
FACTOR aL Saoss Sasso 11. 43 
ERROR 10 4.667 O. 467 
TOTAL 11 10,000 
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TAB Eas 
EXTREMES OF SIGNIFICANT ANOVA 
DENSITY ANALYSIS: LS TERG@E IPG view 
Monochrome 10U versus Color 10S 
Batch 
NO SIGNIFICANT DIFFERENCES NO@ED 
SubBpacch 1 
NO SIGNIFICANT DIFFERENCES NOTED 
SUbBa Seine Z 
F-ratio value = 4.96 


ook Value 
SOURCE 
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TABLE 16 
EXTREMES OF SIGNIFICANT ANOVA RESULTS 
DENSITY ANALYSIS: INTERCELLULAR II 


Monochrome 10S versus Color 10U 


F-Ratio value = 4. 41 
Upper Value 


SOURCE D 
FACTOR 


Lower Value 


SOURCE DF 
FACTOR al 
ERROR 18 
TOTAL 19 
SubBatchl 
Feratio value =5.99 
Upper Value 
SOURCE DFE 
FACTOR ul 
ERROR 6 
TOTAL 7. 
Lower Value 
SOURCE DF 
FACTOR i 
ERROR 6 
TOTAL 7 
SubBatch2 
F-ratio value = 4.96 
Only Value 


SOURCE DE S 
EAC TOR al ot 
Be 


—" 
MOS 
oe e (/ 
~~] 
Cat Ga! 


ERROR LO 1 
TOTAL ata! Z 
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TABRE ay, 


IE OF SIGNIFICANT ANOVA R 
DENSITY ANALYSIS? INTERGEP Gime 


Monochrome 60U versus Color 60S 


Baten 
F-Ratio value = 4.41 
Upper Value 


SOURCE D 
FACTOR 


MS EF 
26. 45 47.14 
O 
Lower Value 


SOURCE D 
FACTOR 


SubBatch 1 
NO SIGNIFICANT DIFFERENCES NOTED 


SubBatch 2 hac 
F-ratio value = 4.96 
Upper Value 
SOURCE DE 
FACTOR al ali 
ERROR ro 
LOLA al 
Lower Value 


SOURCE DE 
FACTOR 1 
i 


Ei 
S 35.00 
7 


ERROR a 
Lomas aL 
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Monochrome 60S versus Color 60U 
Bbacch 
F-Ratio value = 4.41 
Upper Value 


SOURCE D 
PACTOR 

ERROR al 
ee elk, al 


Lower Value 


SOURCE D 
bACTOR 

ERROR i 
TOTAL af 


Ssubbacchl 
F-ratio value =5.99 
Upper Value 


SOURCE 1 
Poctok il 
ERROR 6 
TOTAL i 


Lower Value 


SOURCE iB, 
FACTOR 

ERROR 

AU OA eye: 


SIOHH] 


SubBatch2 


Fe-ratio value 


H 
ifs 


. 96 
Upper Value 

SOURCE DFE 
FACTOR i 
ERROR 10 

Ow AL, ileal 
Lower Value 


SOURCE D 


- 


ig 
ee 


Je} 
Sots) 


a 
5108 


TABLES 
SUMMARY OF DENSITY ANALYSIS IMPROVEMENTS 


Baten SubBateh 2 SubBacteneee 
intracel! 
10 seconds 
MU vs MS 520 LOO >. O* 
CU vs -¢€s OP, 520 10370 
60 seconds 
MU vs MS S020 72,0) 10) B10, 
CU vs4Cs 45.0 45.0 30.0 
Intercell 
10 seconds 
MU vs CS 
Monochrome US O--© O@ S10 
Co rot S Of © 0.0 0.18, 
MS ve Cu 
Monochrome §& nOK. 18, = ©) Se 8, 
Color US O16: Oro 3), 18, 
60 seconds 
MU vs CS 
Monochrome US see ©, O20 O20 
Color S OPM, 5. 0 is pms ©, 
Ns vsexeeu 
Monochrome § ORO OO L020 
Color US O20 O- 0 S00 


Percentage calculation: total number of differences 


total comparisons 


* Unsaturated display showed improvemenu Al escra- 
pee olan results indicated saturated display was 
etter. 


COLor 
saturated 


monochrome 
unsaturated 


nO 
mt 


i= 
Us= 


oe 


2. SubBatch 1 
a. 10 Seconds 
(1) Intracell Comparisons. 

90% or more of all the elements supported the null hypothesis (95% in 
the color case). As with the Batch results, the saturated displays always had the higher 
percentages of correct responses. 

(2) Intercell Comparisons. 

(1) Monochrome Unsaturated vs Color Saturated. No differences were 
noted, the extended hypothesis seems to be valid. 

(2) Monochrome Saturated vs Color Unsaturated. 3 differences were 
found, all but | of these were explained by the basic relationship. The remaining 
difference was in Q2. 

b. 60 Seconds Exposure Times 
(1) Intracell Comparisons. 

As with the batch results,55% of the color elements supported the null 
hypothesis. 80% of the monochrome elements showed no difference. In both cells the 
saturated display was ‘better’ than the unsaturated one. 

(2) Intercell Comparisons. | 

(1) Monochrome Unsaturated vs Color Saturated. 8 differences were 
found, with all but | being attributable to the basic relationship. The hostile element 
was ‘better’ in the color displays. 

(2) Monochrome Saturated vs Color Unsaturated. Only three 
differences were found, all explainable by the basic relationship. 

3. SubBatch 2 
a. 10 Seconds 
(1) Intracell Comparison. 

85% or more of all the elements supported the null hypothesis (90% in 
the color case). The saturated displays had the higher percentages of correct responses 
in all but 3 cases. In the monochrome cell the elements submarine, neutral, and 
neutral air were all better in the unsaturated displays. 

(2) Intercell Comparison. 

(1) Monochrome Unsaturated vs Color Saturated. 1 difference was 

noted and unexplainable by the basic relationship. The element QI! was better in the 


monochrome displays. 
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(2) Monochrome Saturated vs Color Unsaturated. 1 difference was 
noted and unexplainable by the basic relationship. The element neutral surface was 
better in the monochrome displays. 

b. 60 Seconds 
(1) Intracell Comparisons. 

70% of the color elements and 100% of the monochrome supported 
the null hypothesis. 80% of the monochrome elements showed no difference. In both 
cells the saturated display was ‘better’ than the unsaturated one. 

(2) Intercell Comparison. 

(1) Monochrome Unsaturated vs Color Saturated. 9 differences were 
found, with all but 5 being attributable to the basic relationship. The elements for 
total response, air, neutral, friendly air, and hostile surface all indicated better color 
results. 

(2) Monochrome Saturated vs Color Unsaturated. Three differences 
were found, none explainable by the basic relationship The clements for surface and 
neutral were better in monochrome, but the element for QI was better in the color 
display. 

4. Initial Conclusions from the Density Analysis 


1) At the 10 second viewing time,the density null hypothesis holds valid. There 
does appear to be a slight tendency for saturated displavs to be better. 

2) At 60 second exposure times, the density null hypothesis appears to be false 
with regards to the Batch and to Sub_Batch 1, the alternative hypothesis 
indicating that the populations are different seems to hold (favoring the 
Saturated populations as being better). Sub Batch 2 supports the null 
hy NE in the monochrome cell, but agrees with the previous alternate in the 
colonel: 


3) At 10 seconds, the extended null hypothesis also seems_to be valid with a very 
slight tendency towards monochrome displays being preferred. 


4) At 60 seconds, the extended null hypothesis seems to be valid for the Batch and 


for Sub Batch |. However, the_color display seems to have some positive cffect 
on the responses of Sub Batch 2, the Unfamiliar population. 


E. COLOR ANALYSIS 
The color null hypothesis stated that the addition of color would have no effect 
on the number of correct responses. The alternate hypothesis stated that the addition 


of color will effect the number of correct responses. 


Ho: M = ™ 


OC C m 
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An initial comparison was done using an AOV test on the two primary cells, 
while holding all other factors constant (1.c., monochrome 60sec saturated versus color 
60 sec saturated). The results of this comparison should show the effect of the basic 
factor (color). Following this analysis three more qualitative comparisons were 
conducted. These additional comparisons tried to determine whether a synergistic effect 
occurred -- 1.e., two or more of the factors combined and caused an improvement to be 
noted. 

First, the significant results of the color factor tests were qualitatively compared 
to those significant results which could not be accounted for by the time factor. From 
this comparison, two outcomes were possible: onc, the color factor alone could explain 
the result or two, the result was duc to both factors. 

Second, the significant results of the color factor tests were qualitatively 
compared to those significant results which could not be accounted for by the density 
factor. As noted above, there were two possible outcomes, one, the color factor alone 
could explain the result or two, the result was duc to both factors. 

The last comparison used the significant results of all three factors. Any 
difference which was found to be the result of the dual effect of color and time as well 
as the dual effect of color and density was determined to have had a triple interaction 
of the three factors (1.c., a total synergistic cffect). 

For example, in Appendix C, Tables 26, 27, and 36 were qualitatively compared, 
with the results shown in Table 37. 

A summary of the significant ANOVA results are in Tables 20 - 22. Table 23 
shows the percentages in terms of the pooled secondary cells (1.c., 140 comparisons). 

1. Batch 

a. Color 
In only 4.3% of the comparisons were there significant differences between 
the color cell and the monochrome cell. In all these cases, the color cell showed better 
results. 
b. Color plus time 
None of the results from these comparisons could be related solely to the 
effect of color. Of the dual effects, 7.1% showed improvements with color and time. 


However, 9.3% showed improvement with monochrome and time. 


a3 


TABLE 20 
EXTREMES OF SIGNIFICANT ARG a 
COLOR ANALYSISTINTERGEVEO Pai 
Monochrome 10 versus Color 10, unsaturated 
Batch 
NO SIGNIFICANT DIFFERENCES NOTED 


SubBatch 1 
NO SIGNIFICANT DIFFERENCES NOTED 


SubBatcen 2 
F-ratio value = 4.96 
Only Value 


SOURCE DE 
PAGCTOR 1 
i 


W1© 
“IO 


BRROR . 
TOLAL i 
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EXTREMES OF SIGNIFICANT ANOVA RESI 
VSiS4INTERCELEUIAR i 


Monochrome 10 versus Color 10, saturated 
Batch 


FeRatio value = 4. 41 
Only Value 
SOURCE D 


SubBatch 1 
Feratio value = 5.99 
Upper Value 


SOURCE D 


lak M 
FACTOR 1 ZA 9.94 
Vs Me 


Lower Value 


SOURCE DE 
FACTOR al 
ERROR 6 
ARCH SUE: fi 


(019, Se O18) 
Se 


SubBatch 2 
NO SIGNIFICANT DIFFERENCES NOTED 


Sy 


TABI ER 


EXTREMES OF SIGNIFICANT ANO 
COL I is 


ETE AOR ESUiE ts 
OR ANALYSIS TNTERGES I] 


V 
ULA 
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Monochrome 60 versus Color 60, unsaturated 
Batch 
F-Ratio value = 4.41 
Upper Value 


SOURCE DF 
FACTOR iL 
ERROR 18 
TOERAG 19 
Lower Value 


SOURCE DF 
FACTOR ik 
ERROR 18 
TOTAL 188) 


Jz) 
il.ca 


SubBatch 1 
NO SIGNIFICANT DIFFERENCES NOTED. 


SubBatch 2 
F-ratio value = 4.96 
Upper Value 


SOURCE DE S M 1S 
FACTOR cr Zs L230 18; 0€ 
ERROR ue, 6 8) ley! 
LOLA ibat 8 


Lower Value 

SOURCE DF 

FACTOR al 
1 


ERROR a 
TOTAL 1 
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TAD Le 23 
SUMMARY OF COLOR IMPROVEMENTS 


Batch SUDbp atch mSllobatccan 2 

Fure Color 4.3 1.4 4.3 

On@ OO O 
Color plus Wel. a O ores. 
time 

9.3 520 on 8, 
Color plus ZO Ox0 3.46 
density 

S.-O Oey 29 
Color plus Ory. Oey OO 
time us 
density 

EA, O80 O20 
Total effects 
Colon 14.1 14, 1 i I 
Monochrome 9.3 5 Oo WS 
Total 23.4 HES Hegel Viloye Al 


Percentage calculation: total number of differences 


total comparisons 


Upper number indicates improvement in multicolor over 
monochrome. . 

Lower number indicates improvement in monochrome over 
Mic icoLor. 


Se, 


c. Color plus density 
One of the results from these comparisons could be related to the effect of 
color. Of the dual effects, 2% showed improvements with color and density; 3% 
showed unprovement with monochrome and density. 
d. Color plus time plus density 
Only one result (.7%) seemed to indicate a triple interaction; this result was 
for 60s, saturated, hostile surface. 
2. SubBatch 1 
a. Color 
In only 1.4% of the comparisons were there significant differences between 
the color cell and the monochrome cell. In both these cases, color cell showed better 
results. 
b. Color plus time 
None of the results from this comparison could be related solely to color 
effect. Of the dual effects, 12% showed improvement due to color and time. 5% 
showed improvement due to monochrome and time combination. 
c. Color plus density 
None of the results from this comparison could be related solely to the 
color effect. The only dual effect noted was for the monochrome/density combination: 
ace 
d. Color plus time plus density 
The triple interaction occurred only once (.7%) with color, GO "see 
saturated hostiles showing the improvement over the monochrome cell. 
3. SubBatch 2 
a. Color 
There were significant differences in only 4.3% of the comparisons. In all 
cases, the color cell showed better results. 
b. Color plus time 
As in the other two analysis (Batch and Subbatch 1), none of the results 
could be explained by the basic factor of color. Of the dual effects, 9.3% showed 
improvement in the color/time combination. 5% showed improvement in the 


monochrome/time combination. 
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c. Color plus density 


Only one result could be explained by the basic factor of color. Of the dual 


effect, 3.6% showed improvement with the color and density combination. 2.9% 


showed improvement with the monochrome/density combination. 


l) 
2) 
3) 
4) 


5) 


6) 


F, 


d. Color plus time plus density 


No triple interaction was noted. 


4. Initial Color Conclusions 


The color null hypothesis seems to be valid when the effect of color is analyzed 
In a Static sense, relative to the two other basic factors of time and density. 


The color null hypothesis seems to be invalid when the dual effect of color and 
time 1s analyzed. 


The color null PES seems to be valid when the dual effect of color and 
density 1s analyzed. 


The color null hypothesis seems to be valid when the possibility of triple 
interaction 1s analyzed. 


Overall, when these results are combined, looking for any_type of effect of 
changing the display type (monochrome or color), 19 to’ 25 percent of the 
results showed an effect. This percentage would tend to disprove the color null 
hypothesis. 


The color displays seem to have a greater positive effect (14,1%-17.2%) on the 
number of correct responses than did the monochrome displays (5%-9.3%). 
Vhis fact is shown very clearly in both subbatches. 


CHUNKING ANALYSIS 


As discussed in Chapter I, chunking involves the mental grouping of symbols 


based on some type of relationship which allows the user to, theoretically, recall 


information faster and with greater accuracy. The basic chunking null hypothesis was 


that there would be no significant difference between the number of correct responses 


for a given element of a group and other elements within that group. The extended 


chunking null hypothesis (xch) was that the addition of color would not affect 


chunking if the basic hypothesis was wrong. 


H :M = M 
och C m 
H X = X 


xch C m X = chunking changes 


c = color 


m = monochrome 


6] 


This analysis extended only through the first 4 groups. Each element, with the 
exception of the quadrant elements, was compared to its associated elements in the 
group, using an AOV test. The quadrant elements were compared using percentages, 
due to the differing numbers of symbols in each quadrant. If an element was found to 
be significantly different from all other group elements, this could show that it had 
been selectively chosen or ignored. If the element differed from 2 or more elements, but 
not from all, then partial selection could have been in effect. For example, if Quadrant 
1 (E17) was significantly different from Quadrant 2 (EIS$), Quadrant 3 (E19) and 
Quadrant 4 (E20), then complete selection (for or against) occurred. If Quadrant | 
differed only from Quadrants 2 and 3, then partial selection (for or against) occurred. 
These comparisons were made within each primary cell and then a qualitative 
comparison was made between the primary cells. In addition, the results were 
compared to the information provided by cach subject on the questionnaire. The 
questionnaire results are shown in Table 24. The cell comparison results are shown in 
Eicune 3.5 

1, Batch 

a. 10 seconds 
(Te Color. 
(1) Type. No evidence of chunking. 
(2) Threat. In the saturated display, there was one instance of 
complete selection against the friendly element. 
(3) Type and Threat. No evidence of chunking. 
(4) Quadrants. In the unsaturated display, partial selection occurred 
for Quadrants | and 4. 


In the saturated display, partial selection occurred for Quadrants 2 and 


(2) Monochrome. 
(1) Type. No evidence of chunking. 
(2) Threat. No evidence of chunking. 
(3) Type and Threat. No evidence of chunking. 
(4) Quadrants. In the unsaturated display, there was one instance of 
complete selection for Quadrant 2. There was also partial selection against Quadrants | 
and 4. 
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T 
SUMMARY OF 
BAS | 


Method Geil Celle 
Pure Quadrant 0 3 
ene ince at l 0 

uadrants 
plus type l = 
Ougerants 
plus threat 5 l 
uadrants 
plus pattern 0 l 
Variable 4 0 
Cell 1 = Primary cell, Color, Batch 


Cell 2 


Primary cell, Monochrome, Batch 


pattern = geometric pattern between two or more 
elements 


variable = method changed throughout experiment 
Quadrants, Threat, Type, Patterns 


Reconstruction phase was dominated by quadrants. 
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Figure 3.35 Chunking Results. 
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In the saturated display, there was complete selection for Quadrant 2. 

There was also partial selection against Quadrant 3. 
(3) Intercellular. In the saturated displays, the friendly elements were 
selected against in the color view. No effect was noted in the monochrome displays. 
b. 60 seconds 
(1) Color. 

(1) Type. No evidence of chunking. 

(Detihreat. “INovevidence of chunking. 

(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection against Quadrant 2. 

In the saturated display, there was complete selection against Quadrant 
1 and for Quadrant 2. 

(2) Monochrome. 

(1) Type. No evidence of chunking. 

(2) Threat. No evidence of chunking. 

(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant 3 and against Quadrant 1. Partial selection occurred against 
Quadrant 2. 

In the saturated display, there was partial selection against Quadrant | 
and 3. 

(3) Intercellular. No significant differences. 
2. SubBatch 1 
a. 10 seconds 
(1) Color. 

(1) Type. No evidence of chunking. 

(2) Threat. In the saturated display, there was complete selection for 
the hostile element. 

(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant | and against Quadrant 3. There was also partial selection 


against Quadrant 2. 
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In the saturated display, there was complete selection for Quadrant 2 
and against Quadrant 3. 
(2) Monochrome. 
(1) Type. No evidence of chunking. 
(2) Threat. No evidence or calniime 
(3) Type and Threat. No evidence of chunking. 
(4) Quadrants. In the unsaturated display, there was complete 
selection against Quadrant 4. There was also partial selection against Quadrant 1. 
In the saturated display, there was complete selection for Quadrant 2. 
Partial selection occurred against Quadrants 3 and 4. 
(3) Intercellular. No significant differences were noted. 
b. 60 seconds 
Ci) Corer. 
(1) Type. No evidence of chunking. 
(2) Threat. No evidence oh ehunking. 
(3) Type and Threat. No evidence of chunking. 
(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant 4 and against Quadrants 1 and 2. 
In the saturated display, there was partial selection for Quadrants 2 
and 4. 
(2) Monochrome. 
(1) Type. No evidence of chunking. 
(2) Threat. No evidence of chunking. 
(3) Type and Threat. No evidence of chunking. 
(4) Quadrants. In the unsaturated display, complete selection 
occurred for Quadrant 3. 
In the saturated display, there was complete selection for Quadrant 2 
and against Quadrant 3. There was also partial selection against Quadrant 1. 
(3) Intercellular. No significant differences noted. 
3. SubBatch 2 
a. 10 seconds 
(1) Color. 
(1) Type. No evidence of chunking. 


(2) Threat. No evidence of chunking. 
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(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant 4. There was also partial selection against Quadrants 2 and 3. 

In the saturated displays, there was partial selection for Quadrants 2 
and 3. 

(2) Monochrome. 

(1) Type. No evidence of chunking. 

(2) Threat. No evidence of chunking. 

(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant 2. There was partial selection against Quadrant |. 

In the saturated display, there was complete selection for Quadrant 2. 

(3) Intercellular. No significant differences were noted. 
b. 60 seconds 
(1) Color. 

ii ype. No evidence of chunking. 

(2) Threat. No evidence of chunking. 

(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant | and against Quadrant 4. There was also partial selection 
against Quadrant 2. 

In the saturated display, there was complete selection for Quadrant 2 
and against Quadrant 1. There was partial selection against Quadrant 3. 

(2) Monochrome. 

(1) Type. No evidence of chunking. 

(2) Threat. In the unsaturated display, there was complete selection 
against the friendly element. 

(3) Type and Threat. No evidence of chunking. 

(4) Quadrants. In the unsaturated display, there was complete 
selection for Quadrant 3 and against Quadrant |. There was partial selection against 
Quadrant 2. 


In the saturated display, there was complete selection against Quadrant 
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(3) Intercellular. The only difference was the occurrence of threat 


chunking in the unsaturated monochrome cell. 


Given the multiple occurrence of quadrant chunking, an attempt was 
made to sce if any type of pattern could be determined, relative to color/monochrome. 
All the results were pooled and then compared. The only significant difference occurred 
in the 60 second, unsaturated pooling. The color cell had 50% more significant 
complete quadrant selections than did the monochrome cell. By specific quadrants, the 
color cel! had more complete selections in Quadrants 1 and 4 than did the 
monochrome cell. 

4. Initial Chunking Conclusions 

1) The basic null hypothesis that chunking would not occur is not valid. Quadrant 
chunking was dominant with some threat chunking. The majority. of subjects 
felt they were using quadrants (either alone or in conjunction with Type/ Threat) 
to recall information. 

2) Overall, the extended null hypothesis that color would not affect chunking 1s 
valid. There was, only one case where color appeared to assist 1n quadrant 
chunking, Also, in the ten second saturated display better threat chunking 
occurred in the color display. 

3) Despite questionnaire data to show that Type/Threat chunking was being used, 
very little evidence 1s shown for its effectiveness. There is no evidence that Type 
and Threat Chunking (1e., all hostile submarines) was elfective. 


4) Chunking seemed to occur more often and within more groups when the display 
was saturated. 


5) Chunking was no more prevelant in the subjects.who were familiar with NTDS 
than it was amongst those subjects who were unfamiliar with NTDS. 


6) An attempt was made to see whether the amount of time used to chunk (Badre 
1982, p..901) or the total time needed to accomplish a_task (reconstruction) 
Nets with display type (color or monochrome). No significant differences were 
noted. 
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IV. CONCLUSIONS 


A. OVERVIEW 

Chapter III presented the basic analysis of this experiment and the_ initial 
conclusions reached as a result of that analysis. The primary purpose of the present 
chapter 1s to look at those conclusions and determine if the hypotheses presented in 
Chapter Two were indeed valid. 

Finally, some thought will be given to the practical implications of this experiment. 
Specifically, the key question in this area is; would the implementation of a system of 
partially redundant color coded displays be worth the time, effort, and most 
significantly, expense. 

To summarize, the following null hypotheses were proposcd at the beginning of 


the experiment for testing. 


aay POTHESIS 1. 
Color would have no effect on a subjects ability to perform a Search and 
Detection (S & D) Task. 


Pee POTHESIS 2. 
Color would have no effect on an S & D task in a high target versus low target 


(saturated vs unsaturated) environment. 


Sey POTHESIS 3. 
Color would have no effect ona S & D task when the subjects exposure time to 


the display was varied from short (10 seconds) to long (60 seconds). 


4) HYPOTHESIS 4. 
The effect of color, if any, would not be influenced by the subject’s previous 


experience with the code. 


wey POTHESIS 5. 
Subjects would utilize some form of chunking to recall target information, but it 


would not be effected by the addition of color to the displays. 
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In addition to the above hypothesis, another null hypothesis was suggested 


during the basic analysis of the data. 


6) ia ¥YPOTHESTS<6: 
There would be no synergistic effects between the basic factors of time, density, 


and color. 


There were also three underlying null hypotheses tested in this experiment, which 


interrelate to the first five hypotheses. 


(BeOCeOIDo losis; 78 
An increase in exposure time would not ‘effect performance regardless of display 


density or color. 


Sion VP OUTME SI Ses: 
An increase in target saturation would not effect performance regardless of 


exposure time or color. 


Do Fly POTRESIS 9: 
Chunking would occur regardless of display density, exposure time, or the color 


coding in effect. 


Bo EFRECR OF COLOR 

The analysis results would seem to disprove hypotheses one and six. Whether 
acting alone, or in some form of synergism with the other basic factors, the addition of 
color resulted in an overall improvement in performance of 14.1%. This effect was 
strongest in SubBatch 2 (those subjects Unfamiliar with NTDS symbology). SubBatch 
2 showed an overall performance improvement of 17.2%. As mentioned in Chapter 
III, research has shown that the more unfamiliar a code, the more color would be of 
benefit in the task. (Teichner, 1977, p. 17) Flowever, SubBatch 1 also showed a strong 
overall improvement of 14.1%. This improvement could be attributable to better 
chunking - despite the fact that the chunking analysis did not indicate any effect due to 
color. An additional possibility is that the artificiality of the experiment (classroom 
environment with slide projected displays) may have nullified any experience factor, 
hence making both subbatches, in effect, ‘unfamiliar’ with the code. According to Frey 
(1976), color should cease to be an improvement factor as the subjects familiarity with 


the code increases. Since SubBatch | did show definite improvement, there would seem 
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to be 2 possible explanations.The first 1s that the subjects were not as experienced as 
defined by Frey (the above artificiality explanation might also account for this). The 
second possibility is that chunking was in fact improved by the addition of color, but 
the analytical proof was masked by unaccounted for variables in the experiment. 

Color seems to have had a greater positive effect when coupled with changing 
exposure times. AS exposure time increased, more improvements in the subjects 
performance were noted for the color cell than for the monochrome cell. This was 
especially apparent in SubBatch | (this seems to support the idea of more effective 
chunking by SubBatch 1). This analysis would seem to disprove hypothesis number 
BRnce. 

Color seems to have very little or no effect when viewed in conjunction with 
display density. Relative to the monochrome display, color is neither any better or any 
worse. This section of the analysis tends to support hypothesis two. 

As discussed previously, color seems to have had no apparent effect on the 
subjects mechanisms for chunking data. However, inferences from other areas of 
experimental analysis appear to indicate that chunking could be enhanced by the 
addition of color. The analysis also seems to indicate that this enhancement would be 
marginal and not of any overwhelming consequence. A possible explanation for this 
fact could be that while color provides the subject with an additional strategy path, 
especially for those familiar with the symbology, this strategy has a much lower 
priority in the chunk than the more prevalent quadrant chunking. 

Finally, the analysis seems to support hypothesis number four. Regardless of the 
subjects knowledge level, the two SubBatches indicated relatively small differences in 


improvement with skill level (1.¢., 14.1% versus 17.2%). 


C. UNDERLYING CONCLUSIONS 

This analysis did not support hypothesis number eight. With longer exposure 
times, significant improvements were noted, regardless of the type of display being 
viewed. This result was expected as it was assumed an increase in available viewing 
time would allow more time for the development and employment of an effective 
chunking strategy, or simply to conduct more chunking, regardless of effectiveness. 

The analysis did not support hypothesis number nine. For the most part, the 
more saturated a given display, the more improvement was noted. This result could be 


due to the increased number of items available in the field. In other words, the 


al 


subjects had more paths to use in chunking (shape, location, number, color, patterns). 
This may have reduced the number of chunks, but also increased the number of 
elements in each chunk, thus increasing overall the number of correct responses. This 
would support more effective chunking when the intricacy of the display increases. 

As shown throughout the previous paragraphs, hypothesis nine, chunking, 1s a 
valid idea. In setting up the experiment, it was expected that tactical relationships 
would be used to form the chunks, in fact the displays were created utilizing tactical 
relationships between the symbols used. This method was mentioned by the subjects 
in the questionnaire responses, but a quadrant strategy (geometric relationship) seems 
to have been the dominant method employed. Given the perceptions of the test 
subjects, it could be that quadrant chunking was the overall method used, but selection 
of initial quadrant, and recall of the symbols within it may have been based on tactical 
relationships. Insufficient information ts available to determine if this was indeed the 


Case. 


D. DISCUSSION 

One more question remains- specifically, does the improvement factor indicated 
by a partially redundant color code justify modifying current systems to iniplement it. 
The most pressing factor relating to this question revolves around the cost of such 
upgrading. This cost would be spread throughout a system, software modifications, 
personnel training, and most importantly, hardware. In one ASWPRO_ study 
(Campbell, 1980, pp. 42-43), it was stated that the cost difference between comparable 
color over monochrome systems was a two fold increase. Comparable being defined as 
identical memory available for data processing, same raster scan rates, and at same 
comparative level of technoiogy. Given current 1986 technology, the cost of color 
upgrade would still be significant (the cost of color components over monochrome is 
still roughly 2:1). 

The results of this experiment seem to indicate approximately a 14% increase in 
performance with color displays. This level of increase would appear at first to be 
significant in the data overload world of a Combat Information Center. The key factor 
that must be considered is that these results occured in a very controlled environment 
were the only concerns were plotting the data points correctly. A CIC under Combat 
conditions is a very noisy and distracting place, the effect of color coding may be better 


Or worse under actual conditions. A review of the available Literature indicates that, 


to date, no studies utilizing color codes codes in realistic military environments have 
been completed. Therefore, no firm commitment for or against employment of a color 
code can be made. 

Another way of looking at the results would be to see which display type resulted 
in more robust performance under stress. Neither display seemed to aid performance 
when time was the constraining factor (1.e., at 10 seconds). When density was also 
included, both color and monochrome displays reflected the same degree of 
improvement as density increased and viewing time remained short. As viewing time 
increased to 60 seconds, the color displays showed improvement over the monochrome 
ones. These results would seem to indicate that under some types of stress (short 
viewing time with lots of targets), 1t does not matter what type of display you have 
(color or monochrome), in other situations (long viewing time and lots of targets) color 
appears to help. Given the need for quick responses to what essentially would be short 
viewing time data, color may not be of any real benefit in a tactical plot. 

The impact of the discussion is to bring out the requirement for defining exactly 
what a partially redundant color code is expected to do for the operator. It appears it 
will not improve performance under all conditions. It can be of benefit in certain 
aspects of employment such as new users, or long decision making times. The results 
of this experiment seem to indicate it may not be of any tangible benefit under very 
rapid response conditions. Therefore, given the limited nature of this analysis-- limited 
subjects, artificial environment, only | type of tactical display employed-- 1t would 
seem that the addition of partially redundant color coding should not be considered an 


overriding priority in attemipts to improve tactical data assimilation. 
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APPENDIX A 
EXPERIMENTAL MATERIALS 


This appendix shows the experimental materials, the pixel mapping and the 


subject descriptions. 
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SecA 10 


You are the AntiSubmarine Warfare Commander CASWC) aboard 
Bene USS Coral Sea. Your Battlegroup is in an increased 


readiness status due to recent political problems in Libya. 


You have just entered the ASW CIC and are preparing the 
mow Situation Brief For the BG Commander. Unfortunately, shortly 
meeeaejou begin, the NIDS screen goes blank. Luckily, there ore 
Seremorank NIDS Forms lying around CIC so you can reconstruct 


Mee current display. The Admiral will expect a thorough tactical 


Seciering from you. 


is 


RECONSTRUCTION SHEET 


H7DS SYMBOLOGY 


SYMBOL 


CIGB<7OC5)N0 


DESCRIPTION 


FREENDLY SURFACE 


FRIENDLY AIR 
FRIENDLY SUB 


HOSTILE 
HOSTILE 
HOSTILE 
MEUTRAL 
REUTRAL 
MEUTRAL 
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SURFACE 
mIR 
SUB 
SURFACE 
AiR 
SUB 


C1) Describe 


display 
Hid your 
Did your 


Dag Yvour 


Questionaire 


WOUG Dieser le wee a lSSCOnStEsuceing Ene 


Cie by 
Eaeeic 
EGGCELE 


LoOcerte 


quadrant, subgroupings, threat]. 
change as the exposures time changed? 
Change as the density changed? 


change as the experiment progressed? 


Peeveur DISPLAYS ONLY HAD ONE COLOR GO TO QUESTION 3. 


Me.eLia selor aid or distract you in the: 10 sec viewing? 


60 sec viewing? 


C3) Was the 10 second viewing time: 


ee 


GJ 


aq) sufficient 
DI EOO Sloane 
= eG) 1-Ge Sner c 


when the display was saturated? 


when the display was unsaturated? 


Was the 60 second Viewing time: 


Gesues Lelent 
So eceen long 
cj) too short 


when the display was saturated? 


when the display was unsaturated? 


We would appreciate any comments you have about the 


experiment. 


Thank you. 
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Navy Tactical Data System Symbology FPIXAEL Maps 


GROUP: Friendly Contacts Color Coded: EBiUEs 


TYPES: Surface Air Submarine 
xXx XXXxX 
x x x x 
x x xX x X 
x x x x x xX x x xX x 
x x x Xx xX 
x x x x 
XXX xxXXX 
GROUP: Hostile Contacts Color Coded: RED 
TYPES: Surface Air Submarine 
x x 
xX xX x xX 
x x x x 
x x x x x x x x x 
x x x x 
xX Xx x Xx 
x x 
GROUP: Neutral CoMmeacus Color Code GREEN 
TYPES: Surface Air Submarine 
XXXXXXX XXXXXXX 
x x x x 
x x x x 
x x x x x x x x x 
x x x x 
x x x x 
XXXXXXX XXXXXXX 


Figure A.3 Pixel Mapping. 
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TABLE 25 
SUBJECT BACKGROUND 


Subject Desig SubBatch Display Type 
] 1110 l M 
7) 1110 l M 
3 1110 l M 
4 1110 l M 
5 1110 ~ M 
6 1100 l M 
7 1110 I Cc 
8 1110 l C 
9 1110 ] Gc 
10 1110 l e 
1] 1320 2 M 
92 CAND 2 M 
13 1120 2 M 
14 1320 2 M 
15 1100 2 M 
16 1110 jl M 
17 1310 2 C 
18 1105 2 C 
19 1100 2 c 
20 1100 2 c 


S| 


APPENDIX B 
SELECTED MINITAB RESULTS 


The first 3 figures of this appendix show raw Batch data, displayed graphically to 
show the effect of color on the subjects. 
The next 9 figures, shows an illustrative set of AOV results, as prepared by 


MINITAB. This example set is from the Chunking Analvsis. 


a 





ILLUSTRATIVE GRAPHS SHOWING SIGNIFICANT RESULTS. 60 SECOND, UNSATURATED 
GRAPHIC DISPLAYS OF CORRECT RESPONSES MONOCHROME VERSUS COLOR 


(BATCH) 
C - B BOB AB 
0 = 
R 3.66 
R = 
E . B B B B 
c = 
T = 
2.4 ; 
R = 
E = A A oA B A A 2 
S$ = 
Pp z 
0 1.2¢ 
N x A A 
E - 
os = 
0.0° A 
ern Dc <9 en ee grrr Sa 
0.0 2.0 4.0 6.0 8.0 10.0 
SUBJECTS 
A = MONOCHROME, FRIENDLY 
B = COLOR, FRIENDLY 
2. BOTH A AND B HAD SAME NUMBER OF CORRECT RESPONSES 
- 0 aed 
[e - 
Oo 1.80¢ 
R - 
R - 
E a 
io - 
T 1.20¢ 
R = a 062 A a 2 (Bo 2 
E - 
I ~ 
P 0.60 
Oo = 
N ~ 
E - 
S$ - 
0.00¢ A 2 A oA A 2 
Cmca wee Ss ae — Comms ee ee oe Peewee eee = = tewewew wes == Caeewwee oe = Cee wees 
0.0 2.0 4.0 6.0 8.0 10.0 
SUBJECTS 


A. MONOCHROME, FRIENDLY SURFACE 
B. COLOR, FRIENDLY SURFACE 
2. BOTH A AND B HAD SAME NUMBER CORRECT RESPONSES 


Figure B.1 Raw Data Graphs I. 
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4aomuvueaono 


vumuirzeaeaowvum a 


= B B B B A 2 B B 
G . B <4 
- A A 
z s 6 ba 
- 2 A B 
2.4? 
- A B 
Loe? 
= A A A 
Comes = sews tee ewe ee See 4 eee eee SS Ome eee et ee Cem e we wees § eee eee 
0.0 2.0 4.0 6.0 B.0 10.0 
SUBJECTS 
A. MONOCHROME. CIRCLE 4 
B. COLOR, CIRCLE 4 
<. BOTH A AND B HAO SAME NUMBER OF CORRECT RESPONSES 
- B 
3.69 
= B B B B A B 
2.4¢ 
- A B A 2 A B 
eee 
- A A B A 
0.0¢ A A 
@oce Bo See aes @emere os eee teeeee eee = eee ee eee — Cem eeeeerer= be a oe 
0.0 2.0 4.0 6.0 8.0 10.0 
SUBJECTS 


A. MONOCHROME. QUAORANT 1. CIRCLE 4 
B. COLOR. QUADRANT 1. CIRCLE 4 
2. BOTH A AND B HAD SAME NUMBER OF CORRECT RESFONSES 


Figure B.2) Raw Data Graphs II. 
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«0 4.0 6.6 8.0 190.0 
SUBJECTS 


A. MONOCHROME, HOSTILE SURFACE 
B. COLOR. HOSTILE SURFACE 
2. BOTH A AND B HAD SAME NUMBER OF CORRECT RESPONSES 


Figure B.3. Raw Data Graph III. 
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ILLUSTRATIVE EXAMPLES DF ADV SIGNIFICANT DIFFERENCES 
SIGNIFICANT DIFFERENCES: CHUNKING ANALYSIS S8ATCH 


(F-RATID > 4.41) 
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OF VARIANCE 
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MS F 
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FRIENDLY (E€ 5) VERSUS HOSTILE (E 6) CDLOR 10SEC SATURATED 
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FRIENDLY (E 5) VERSUS NEUTRAL (E 7) COLDR 1OSEC SATURATED 
ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
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TOTAL 
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aa sf 


OF 

1 
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POOLED STDEV s 


Figure B.4 
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BASED ON POOLED STDEV 
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AOV Results: Chunking Analysis I. 
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SURFACE (E 3) VERSUS SUSMARINE (E 
ANALYSIS OF VARIANCE 


SOURCE DF ss MS 
FACTOR 1 92.45 92.45 
ERROR 18 96.10 5.34 
TOTAL 19 188.55 

LEVEL N MEAN STDEV 
E 3 10 7.300 2.003 
—E 4 10 3.000 2.582 


POOLED STDEV = 2.311 


SURFACE (E 3) VERSUS SUBMARINE (E 
ANALYSIS OF VARIANCE 


SOURCE DF oo MS 
FACTOR 1 24.20 24.2 
ERROR 18 34.00 1.89 
TOTAL 19 58.20 

CEVEL N ME AN STDEV 
Es 10 < .-800 1.687 
E 4G 10 0.600 0.966 
POOLED STDEV = 1.374 


4) COLOR 60SEC SATURATED 
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FRIENDLY (E 5) VERSUS HOSTILE (E 6) MONOCHROME 60SEC UNSATURATED 


ANALYSIS OF VARIANCE 


SOURCE DF he) MS 
FACTOR 1 bie. cs 
ERROR 18 27.70 1.54 
TOTAL 13 38.95 

LEVEL N ME AN STDEV 
E 5 10 1.800 1.033 
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Figure B.5 AOV Results: Chunking Analysis IT. 
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SURFACE (E 3) VERSUS SUBMARINE (E 4) MONOCHROME 60SEC SATURATED 
ANALYSIS OF VARIANCE 
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BASED ON POOLED STDEV 
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FRIENDLY (E S) VERSUS NEUTRAL (E 7) MONOCHROME 60SEC SATURATED 
ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 
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BASED ON POOLED STDEV 
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Figure B.6 AOV Results: Chunking Analysis HI. 
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SIGNIFICANT DIFFERENCES: CHUNKING ANALYSIS SUBBATCH I! 
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FRIENDLY (E€ 5) VERSUS HOSTILE (E€ 6) COLOR 10 SEC UNSATURATED 


ANALYSIS OF VARIANCE 
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INDIVIDUAL 95 PCT CI'S FOR MEAN 
BASED ON POOLED STDEV 
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ANALYSIS OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


EVEL 
Ee 5 
E76 


POOLED STDEV = 


DF 
I 
6 
7 


z 


ss 
4.500 
5.000 
9.500 


4.500 
0.8353 


STDEV 
0.8165 
1.0000 


5.40 


INDIVIDUAL 95 PCT CI'S FOR MEAN 
BASED ON POOLED STDEV 


eo oe A ee eee 
{-------- Ha- == ) 
(--------- n-------- } 
ones eee 
256 3.6 4.8 6.0 


Figure B.7) AOV Results: Chunking Analysis IV. 
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Figure B.8 AOV Results: Chunking Analysis V. 


90 


FRIENOLY (E 5) VERSUS NEUTRAL (E 7) MONOCHROME 60SEC UNSATURATED 


ANALYSIS 

SOURCE OF 
FACTOR 1 
ERROR 10 
TOTAL 1) 
CEVEL N 
ES 6 
E 7? 6 


POOLEO STOEV = 


OF VARIANCE 


$s 
8.33 
15.353 
23.67 


8.33 
1.53 


SURFACE (E 3) VERSUS SUBMARINE (E 
ANALYS1S OF VARIANCE 


SOURCE 
FACTOR 
ERROR 
TOTAL 


LEVEL 
Ee 
EG 


POOLED 


OF 

} 
10 
11 


STDEV = 


3S 
36.75 
36.17 
72.92 


MS 
36.75 
se 62 


STOEV 
2.066 


betac 


INOIVIOQUAL 95 PCT CI'S FOR MEAN 
BASEO ON POOLEO STOEV 


e22elee teeoewwreee@ te ewww worn (owe woes 
aaa ee iaaaoaeee eh) 
(-------- -------- } 
aaa Ge ee ron Ses ee 
1.2 2.4% 3.6 


4) MONOCHROME 60SEC SATURATEO 


10.16 


INOIVIOUAL 95 PCT C1°S FOR MEAN 
BASEO ON POOLEO STDEV 


as ps ae een cee ease 
(--------"------- ) 
ee a | 
See ee ee ge 
220 4.0 6.0 


Figure B.9 AOV Results: Chunking Analysis VI. 
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E 5 6 1.33 0.816 (----=-- e-------. ) 

E 6 6 Tasis3 1.366 (2seeeeee esos ) 
Bee wel ee se 

POOLED STDEV « a es 2.4 0% 


Figure B.10 AOV Results: Chunking Avmaiy Sisevele 
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SIGNIFICANT DIFFERENCES: CHUNKING ANALYSIS SU88ATCH 2 
(F RATIO > 4.96) 


SURFACE (E 3) VERSUS SUBMARINE (E 4) COLOR 10SEC SATURATED 
ANALYSIS OF VARIANCE 


SOURCE DF ss MS E 
FACTOR 1 14.08 14.08 6.35 
ERROR 10 coe? 2.22 
TOTAL 11 36.25 
INDIVIDUAL 95 PCT C1'S FOR MEAN 
BASED ON POOLED STDEV 
LEVEL N MEAN STDEV ----- ¢oweeen— wo tee eeen-- + tase enna +- 
ET 6 2.833 1.941 (SS teorscese= ) 
E36 6 0.667 0.816 (ese------ Se ) 
Sseose> Cae wme ee eee — 6 ee me ee He bee ew eww = = + 
POOLED STDEV »# 1.489 0.0° 1.4 2-8 4.2 


FRIENDLY (E 5) VERSUS NEUTRAL (E 7) COLOR I1OSEC SATURATED 
ANALYSIS OF VARIANCE 


SOURCE DF ss MS F 
FACTOR 1 16.33 16.33 8.45 
ERROR 10 ie Pee 1.93 

TOTAL 11 35.67 


INDIVIDUAL 95 PCT CI*S FOR MEAN 
BASED ON POOLED STOEV 


LEVEL N MEAN STDEV ----=+ Ome SES Se Cee See Sse Pees 
eas 6 0.667 Vee Oe a | (-------- tome e-—--— ) : 

E 7 6 3.0090 1.673 (eenne--— wena ae ) 
POOLED STDEV « 1.390 0.0 1.4 2.8 4.2 


SURFACE (E 3) VERSUS SUBMARINE (E 4) COLOR 60SEC SATURATED 
ANALYSIS OF VARIANCE 


SOURCE DE SS MS F 
FACTOR 1 65.33 65.33 13.71 
ERROR 10 47.67 4.77 

TOTAL 11 113.00 


INDIVIDUAL °S PCT C1'S FOR MEAN 
BASED ON POOLED STDEV 


LEVEL N MEAN STDEV ---------- ¢--------- ¢--------- ¢------ 
E 3 6 6.833 1.961 (--+---- u-------- ) 
E 4 6 2.167 2.401 (=—----- #------- ) 

Seoeoae oa fae eens 5 ee a 
POOLED STDEV » 2.183 2.4 4.8 722 


Figure B.11 AOV Results: Chunking Analysis VIII. 
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APPENDIX C 
INTERCELLULAR ANALYSIS 


The following tables show the elements which were significantly different for a 
given analytical test. The tables also show in which display the element was improved. 
If no differences occurred, there is no table for that analysis. 

Tables 26-36 show the intercellular results for time, density, and color analysis. 


Tables 37-42 show the results of the qualitative comparisons discussed on pp. 50-51: 
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TABLE 26 
TIME ANALYSIS ] 


Color 60 Seconds Unsaturated vs Monochrome 10 Seconds Unsaturated 
rarer TERE Indicates COLOR Better {EUHEY Indicates MONOCHRONE Better 
SIGNIFICANT DIFFERENCES NOTED 


_cfesent 9 ..__d____BATCH. ________ SUB BATCH 3 SUB BATCH 2 
alot ume WN il... ce el 
AUGER OOS ee ey ee ee ee | 

iid ie. | ae |) 
etal: SE |) a Ss ee eens mnnnnNE ea 
Oe ee | eel cccl eee. 
Bee ga ee oii ie 2: 
SU Se ee 
perme esnnen | ee eel 
WG ie aa ge i ee ee oe 
mecosesutiace: = | eee oe ........... _ ee 
_.Hos Subearine | | aie Lait de 
crs meer eng ee el 
_ NOD Se en ee eee ee oa 
Neu Suomarine ot enneeaiates 
Pes cre eee eee Pee le ee 
DENIC Sm! ae a ee oe 
eee Pere eee. ee | ee! ee 
6 NEUE Oa ae nai 2s 
Beceem rene Ne hl ee ee 
PEN NCICRE rie Lue | Drone a2. ol faeeme see eo 2 2) Sais. 
_ONEGIG SWE ee oe) | ie ee er oe 
5 ES ee ee nnn Oe." on 
S51 en CC rr 
es AgCenter ce eee Se 
Ee 1 ee (Ge Oe 
ie rr eel een Sel ee 
oe ay Os 5 ee i nine 2 
ECS Re a oe Oe ee | cee oo 
SA Oe es ee eee | ee 
2 UE IRs od (ERI De ore a | are hc 
AEE es I tO os 2 eel ee 
Room eC em gs ee ee oc epee) ceva cence ecce 
NEEL GS a ee ee So eee eee 
NEE SAG Noe ee no ee ee 
BU Ome be ee cee eS ees ee 
CRED © GS i | eS oe ei Renee eee tees Oneenn one 
2 eel ee UN Sn aly eee ee Oe eee 
eUOaE mCi oneraeeen lar ool ees ee | eee se 
Me UAC mamas emesis ere ee eel ee el ee 
_EG CCHS Si eee eae Seneiane | eee 
nT 
_ Quad 8 Cra el 

Guad 4 Cr 5 | | | 


Sees ee @ea SESS SSESZSE SFE SF SF SF SSFTPFSFSFSFSFSFSFSFeFeETUT FETE EEC STFTTT FTG GEG GG EFT FSG TZFZ @® 2M 24 @e eae £82 e¢ 
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TABLE 2 
TIMEVANAL YSIS 


Monochroae 60 Seconds Unsaturated vs Color 10 Seconds Unsaturated 
PULL PRR aS Indicates COLOR Better laf 403 Indicates MONOCHROME Better 
SIGNIFICANT DIFFERENCES NOTED 


eee @Pwevewmeeree@eeewese On Oe Geter see ee St eeae2ees 


Bee 2 1... BATCH _..._1_SUB_LBATCH 1 1 SUB BATCH 2__ 

on)! | nn MeN 

WALD ncceceaceeebeag culate dos. ...!s0sc..00 oe 

_outface | eee ec) 

-oubbatINe ool. ecco cece cel ocee eee 

Jftiendly oo) ea? to 

Hostile... ee 

Neutral ool cee cecccenecel cceeecencessseeeenel ne 

woPE AR coc cod cccl ice cw ecececs dscn ce eee 

ft Suttace io! dbs |__| cso 

Ef Supaarine oo |. ...c....2....!..22 eee 

HOS AIT o-oo bl ecccosdecevacelcclccsescce een 

tos surface 8! cole ccc ccc cll. ee | 
_.fi¢s_suogarine |. ee eee 

Sh. er en | 
Neu Surface... | gle eee 

HOU 2ueRa Tne dee ee sel seccesceeeeessoasieees ean | 
_Wuatrant tll) | 
_yuacrant 20 | a Pole. ee | 
Re i i fo. | 
_ Wuadrant 4. eee | 
Beso) a ee ne 
eS eo or Ue 

_Givele 3) ool eres 

-bircie 4 bere eceee | occ oe cuecee een 

-Oircle.) oo) ee eee ee 

_ uae | or lke 

| Es 9 oy ae ere CO 
_Muad fer 3 dee ee 
Oe ne nS RN 

A Ot i nr | 
ee ee NO ae 

_ hued 20r 2 do... 

oe Cee rs arn ers) (EU 
ea a en Me 
_WUad 2 Cr 3 8 lc cncececencceselececac-n sce eu 
_duad dr tl ee 

quad 3 Cr 2) a ee 

_Wuad_3Ce 3. de 
-Wuad 3 Cr 4 tl... 

_duad Sr 3 | ee ee 

_ ued 4eCr fd 

Quad 4Cr 2 ta ee 
Queda 3 | eee 
duadeener 4 ccc cee cecl con cee 
Mad 4 ce ol. cceceece suet ceess saee enna 
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TABLE 28 
TIME ANALYSIS II] 


Color 60 Seconds Saturated vs Monochrome 10 Seconds Saturated 
Pa HER om Indicates COLOS Better CEM REG Indicates MONOCHROME Better 
SIGNIFICANT DIFFERENCES NOTED 


Stewee Gene GO 4G Ovweeewoet oe @ Gea Gee 2G 2@Fe2a+e 


_Element. 900d BATCH 1 5U5 BATCH 2 1 SUB BATCH 2 
ee. ee! Ul ......|..... oe... 
oN See ee Sa oe 
eae ee | ie pg cl ee)! 
_uomarine || 1 | ieee Tamer 
iC ne ec a 
Hostile Lien aes 
Bed ee en ete le eel. eee. 
SOPRA cha cncacecndccccsccacuccenccocJoneccccecescncocc-o 4-40 Sash Ml 

Meet Cle Ole Le 
_Ft_swogarine |) aitweieitom 
ee 2 a ee ee ee 
pmOsvsuriace NA td 
ots -svowarine ____| __o2.2...-..-..._)_._ ae | ___. 
Peale. 22-2! eeeee......cl..... a.......| eee. 
Peeeiscen ys ee oe. oe caz ze! 2 ea. 
Neu suomarine od pinta ee 
MOSES a a gm Ae 
ESS) SP a ns i cn cc ccc rr 
B11) Sr a Ae 
_Wuadrant 4 |__| _____...._....) Bd 
BOGE ele). | eee 
meomclens 2. ee  .. | ee. 
SS >. 
meiecieny 2) ome... eee. Oe. 
SLES os | i eae nee . 
Pe dca cde cwece)ccdeeoncacoabscnase | sclecacdeicdsecs 
{AWE hs coal Se ee Seen se 
Mpc BCom ema ee he ee ee eo oe 
cee ecko wzd beret is oc add dies 
ee ee dc gone Vries vc anwatbenan liteeccnewbices: 
{TDG 2 Oh) aes 2 | Sea enn CREED.) el ee 
SE ee ae pe ee ee | 
_Wuad 2 Cr 3 RGR des 
_Wuad 2 Cr 4 an 
eRe eee eee 8c ee 
wWvad 3 Crt i 
BRGUTOROmCi ec) ele me Meee cel ee nee 
_Wuad 3 Cr 3) Re atte 
Quad 3 Cr 4 te ee 
_Wuad 3 Cr 5 bination 
_ UE OG? ae eae <r ie aa etre cao eee 
_MUad 8 er 2 ea 
5 0Sn0 DOU SS eee ee ee oe ae eee 
STE, DDE 

Quad 4 Cr 5 | l 


Seve se SB Oe GEOG OBST 2EZ 2G TE STE SGOT SF FBG SOSH st SO@e S28 EC Se CeMesewweGGOwnnveweeaw S282 E2E2 EC EC GOSS 
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TAREE 
TIME ANAL YSISsiy 


Monochrose 60 Seconds Saturated vs Color 10 Seconds Saturated 
Payal Weiss Indicates COLOR Better SEIS Indicates MONOCHROME Better 
SIGNIFICANT DIFFERENCES NOTED 


SS ee ee ®@eeca2 @e G@e ewe Geta Ge Beee ee eee ee 8 ee 22 eo 


_ Element. L____ BATCH © d SUB BATCH 1! SUB LEATCH 2 
Ota ccc becedecso cece ee cec lec ese aes A 
i.) | en 0 ee eo ee 
outface 8. loco ccccccccececdeccssceesueneeeeeee =a 
_suogar ine 8 ol eee 
_Priendly ........ | coeeeee_.__ | _ 
_ Hostile) ee | 
ly | ae nM ae 
is ir) | San (Os ce CO ee 
_t_surtace _..__..! saad _.__.|__. 
eee ee es 
oHOS AIG ee 8 noc) cco occ ce eee ee 
0s Surface 8) oc cccccececccl cca-ce cesses 
_ hos Sudedaine | le 
2) en ce wo aeneer lc. | oe 
_ Neu auriace 98d aes Raed ol Poe) 
le el nn 
ES nn 
LT Ci nN 
,MUatrant 3). bo | ee 
ne ee 
owitctenl 2 ye ee (ee 
_wircle 2 o.oo) 2 see eee | ee ee 
_wincle 3 le ee 
i i 
eis en ne ek 
er es nn en 
_fuad i Cre ce ele 
et i nn ou ONION es 
_uuad 100 6 | le 
i): eh: ON eee. 
_Wuad for td cece te 
|: 49 ey Se GOR ee 
_Wuad 2 Cr 3d oe cece 
_Wuad 2 Ore dn leet ce eee 
Pe a i nn oo ee 
eS oe i RNC en 
Se a ee 
_fuad Surg ool ee 
Wad 3 or 4 i.e .ccc-- te 
_#uad_3 Cro. loot nooo eee ee 
_Wuad 6 Cr toc ced coc ne ee 
me ns rr 
6 nn 
_0vad @ Cr 4) 
_ Guad 4 Cr 5 8b eo. cece ee 
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TAREE 30 
| DENSITY ANALYSIS I 
Monochrome 10 Seconds Saturated vs Color 10 Seconds Unsaturated 
SAD Indicates COLOR Better RUE AY Indicates MONOCHROME Better 
SIGNIFICANT DIFFERENCES NOTED 


@eeceereaewoeee ew ®emee et eee e ef eer ee 2 e2enaenaene = 


_tlesent. 99.) BATCH | SUB BATCH 1d SUB BATCH 2 
ee |. nee Ee a Ne i oe 
Se cca ee 
SiGe ld!) eee 
_ubmaring oo) diem ll 
Geral oid ccs ccdecescescccs }ncon- ee 
POSS 9 a er a ec ae eerie 
Cee ee a! 
iy ihm on cece ccc nee 
2 ea ee he es ten | od 
br supearing ood ited 
SIG yu 2 tt a er ee ee nn ES edt 
(NOE SUL CD 5 eee ee ieee |e cr Ceeeenmree ee ea 
0s See a eee | i ee eee oee ne 
Uo ss RE a a i | AL: ane 
We eee oss ccs ccc eeecl ene--c eee 
ee cn nce bcncncocece cl co ckeee eee 
s Wuadratiet___! ______-.....--.--!_____...-.--...-.-./.. aes 
Se A i i ee 
eC EGll So -  Re ea ie ean Seen e ee Nerney MRIENS i 
eee dee ceca cnasocccud caccadcosuasavecenadssccnncdcescsuec 
ICO | ee aceon, enn ee Sn 
SUC 6 1 ee ees es i 
PMC MN NN ge ones a ee ieee sce 
lets ele ec ae ee ee 
AASIISICL (2 8. 20 Net CS mC 0 eR oe ed 
i ') ee C6 ee. ens tr 
LE US IS oe eer ren ee 
oe | oy ee oe en 2 eee 
STE 1 GS Se 
sm Mm meee de ee cece eee 
eam wee ne ene eee 
SEG) Oe. TSS ae ee ec 
UD Gis) cr Ce | a 
SUITE 2 Giese yo oer Cg gn |e 
SUD G) 2 Ol eh 2) SO cas ire ee Ce 
CUE Cie 8 2A 2s Eg nr gee eg cc 
ATTEN SNC 22 et eee nn, (oe 
BAUS CMU m MOC eo ooc cece deca cawacodensncaeee bocce cacmeceuesee 
Pau aG me MOMMA MER ee os coe ek cee eee cc setae ecece cee 
ee tamer ema oo choc cecnssnce cet cecucecccencoscc 
BEUUAU MORO eel oe ces ee coc cclaken! Seexededseonnet 
EUAGeemO CMe ter ee ee ee eek 
or US Ame ON ee ee. eel 
cum os eee eens ool occesendewcencs 
Quad @ Cr § | | [ 


ens @@ ee SB eG 2 SSS HF SSSESBEHB HEEB EB THA TZ FSF SB S22 F222 S28 G2 THF HF FG STF FZ 8 SFT @@ FBZ F ewe wT fH T TTF Fe 2 T2288 Oe 
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TABEE 1 
DENSITY ANALY Sisal 


Color 60 Seconds Saturated vs Monochrome 60 Seconds Unsaturated 
THEE estat Pe Indicates COLOR Better life cEeS Indicates MONOCHROME Fetter 
SIGNIFICANT DIFFERENCES NOTED 


Element. 9-01 dL BATCH ot SUB_BATCH 11 SUB BATCH 2__ 
en en 
woALE oo. eenccneeclacecececeeccocccerteceececcocseless eile == 
surface...) ec oeeeeee ee. 
Le a en ee 
friendly ________| a 
_Hostile =| cos | _ ee 
1 oe ee nnn ee le 
1: ne ans Sn ee 
ft surface, | eee ee 
_fr susmarine | lee ee 
Oa Ss nein CN ye 
_mos Surface | de Sie 
tes Susarine = | Ue eee eee 
New Alt!) ee 
_ Neu Surface) oli ecacoe lose sc une eee 
NOU SUOMS ne ie clen cen c cessed ee 
ee i 
_Muagtant 2 ius. ceed e.ee 
j MORON SHIR ee ccs See oe ee | eccccecaece eel 
_Auadrant-4) 00! 
_biele) gl ee ee 
a's \i-1 (7 en Te AM 
CIDE 2) oo toca ciel cc ne eee | caUenccuascas.ce a 
WGitelesks oo. ole cccclc. ecco ee 
fitcle sl eel ee ee 
ead 1 ort... ls bel eee 
Weed Cee ccc cacccdeccaclcccnscce. ss ee 
_Muad Gro lo. ee le eee eee 
_WWad {Gr 8 de 
el Ol ie en 
| 8 oe mene n NN NU ee 
aWuad 2 Or?) ue ee eee 
_Auad 2 Cr 3 | | ee 
Quad 2 Cr |. 
_ Wad 2 Gro oe 
ie (ER ENN 
_duad 3 Cr 2 ee 
_Quad_3 Cr3._ | _____-......_ | ee 
_duad J Cr el 
es i 
_Wwad 4Cr to lel 
_Muad 4Cr 220 neti 
_Muad 40rd nnn NT 
ad 4 Cr 8) woo ccaccuel occ oceen 
Quad 4Cr oo...) 
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Was t 32 
DENS yee Sls 11h 


Monochroae 10 Seconds Unsaturated vs Color 10 Seconds Saturated 
rig esate ta: Indicates COLOR Better 2°R-CES Indicates MONOCHROME Better 
SIGNIFICANT DIFFERENCES NOTED 


eeere Se emwreetwtnro etee2eeena tt ® ee ee SSS S88 S888 42 OS 


Element. 99 BATCH oT SUB BATCH 1 SUB BATCH 2 
miles eee I de 
allt Se ane 0 oy er ne i ae 
cua eee | eee | eee 
OUR lee eet. Ion ee lL 
fre ee a ir i ee 
ES) Os i ence Ge eeen einer et | ee 
__ VEU Sh eee ie Oh ee ee eee 
meee ee ee 
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ie eine sl eee | eee 
RCo MO Nieeee ena Oe ol ee 
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5205 500 | in: rnin eee 
Bocce eet ee ce 
Meee ieee owe! lee... 
ae) 2. i nn oe 
kei i i nC .  .e 
PAU eece le: so eee | ee 
MRE lS | ce ee ee 
LICH es See econ een ee 
i EP espe cccacesceceveceslepeiccveuase-c-ac..!... eee. 
Bee Ce ees geen Oe nee etl et. ent | 
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Meee eee eee le el 
oe! os OE St ee ee | eee One 
eee me el ee | cee a 
eee ne. | ee ee... 
BGM tee iene Ne Bel cece oe 
JAIMIE) 1 ESC 5 NTS OA | ene cpm Ra eee wee me eterna 
a Ge ea eee en | es ee ee 
EE ZOU i 6 nr meen «0 ie 
Se ee een. ae Oe oe 
| EAN CSO Sa ee EO <A Ue ee 
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_ EE 1S oe EO ae ee ving Se one cee OOS nie io nee 
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WG OE ei rocks oie eee ee ec c 
Meccun CMe se eee ee ee 
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TABBE 3 
DENSITY ANALY Sisley 


Monochrogwe 10 Seconds Saturated vs Color 10 Seconds Unsaturated 
etl eT HA Indicates COLOR Better  ocnetere 4 Indicates MONOCHROME Better 
SIGNIFICANT DIFFERENCES NOTED 


Element 9! BATCH © SUB BATCH 1 1 SUB BATCH 2__ 
a | nn ere 
Alf wl 
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oubwatine ot eco i ee 
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TABLE 34 
COLOR ANALYSIS | 


Colar 60 Seconds Unsaturated vs Monochrome 60 Seconds Saturated 


GPa etl gt Ji Indicates COLOR Better seid Gla ev abe Indicates MONOCHROME Eetter 
SIGNIFICANT. ___ DIFFERENCES NOTED. 
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TABEE Se 
COLOR ANALYSIS 


Color 10 Seconds Unsaturated vs Monochrome 10 Seconds Unsaturated 
By eR Lay Indicates COLOR Better  <2830EES Indicates MONOCHROME Better 
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COLOR AND DENSITY ANALYSIS II 
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